You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/04/11 00:02:40 UTC
Build failed in Jenkins: beam_PerformanceTests_Dataflow #293
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/293/display/redirect?page=changes>
Changes:
[kirpichov] BEAM-1053 ApexGroupByKeyOperator serialization issues
[chamikara] Create as custom source
[tgroh] Add SdkComponents
[altay] Upgrade dependencies.
[altay] Skip query metrics when creating a template
[altay] Fix GroupByKeyInputVisitor for Direct Runner
------------------------------------------
[...truncated 251.35 KB...]
! 182841a...3a62a5a refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 5e54b6a...61df746 refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2378/merge: No such file or directory
! 8a8f567...c6d11ae refs/pull/2378/merge -> origin/pr/2378/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! e9bfd19...3b11d5e refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! d3a70c5...02f01ea refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 22cbe49...371a50d refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! bfea969...4e897ad refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 93c22ac...f06b0c8 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2411/merge: No such file or directory
! 2a9d9fa...a96af72 refs/pull/2411/merge -> origin/pr/2411/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! fec945f...49fd3ee refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/head: No such file or directory
! e9c395d...d4a71fe refs/pull/2415/head -> origin/pr/2415/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! 867d5d1...52cf5f4 refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! b08de25...66fcdf4 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 6aabe68...1ca8b79 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! eae8214...ff6e93b refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 1874e21...e325586 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/head: No such file or directory
! 854b3a9...d22f59a refs/pull/2430/head -> origin/pr/2430/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! 1daa0d2...9d893e6 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 87049e0...91867d9 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! 452cd35...679f861 refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! f432126...8a475ce refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 52946db...4da4e4b refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2486/merge -> origin/pr/2486/merge
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! bd11ed1...1b17b7a refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 7fd9c6516e2222a5f3d290fd95507559b0c99940 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 7fd9c6516e2222a5f3d290fd95507559b0c99940
> git rev-list 80d2548f258074931a62e412609363dfd2305086 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1645119501670945800.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3306673871647910488.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8230417350239447705.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5402830510053080050.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-11 00:02:39,195 eb108d41 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/eb108d41/pkb.log
2017-04-11 00:02:39,195 eb108d41 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-11 00:02:39,196 eb108d41 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-11 00:02:39,604 eb108d41 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-11 00:02:39,695 eb108d41 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-11 00:02:39,698 eb108d41 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-11 00:02:39,698 eb108d41 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-11 00:02:39,703 eb108d41 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-11 00:02:39,705 eb108d41 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-11 00:02:39,727 eb108d41 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-11 00:02:39,728 eb108d41 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/eb108d41/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #376
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/376/display/redirect?page=changes>
Changes:
[klk] Activate WindowedWordCountIT on Apex runner
[klk] No parallelism for Apex WindowedWordCountIT
[dhalperi] [BEAM-2016] Delete HdfsFileSource & Sink
[tgroh] Run Optimize Imports on the Repository
[tgroh] Move AppliedPTransform into the Runners package
[tgroh] Convert Coder into an Abstract Static Class
[dhalperi] [BEAM-59] Fully delete IOChannelUtils
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0d2a0aeeef92bdbc23e4061ec066da47e3c7de38 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 0d2a0aeeef92bdbc23e4061ec066da47e3c7de38
> git rev-list 3bffe0e0014bdd6ae73dc2e8ecfc2b61d066120c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6165280624966686801.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4580259411695657974.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson991341416332915944.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4900402012477053724.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 18:54:23,115 424c35d3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/424c35d3/pkb.log
2017-05-05 18:54:23,115 424c35d3 MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 18:54:23,116 424c35d3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 18:54:23,645 424c35d3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 18:54:23,740 424c35d3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 18:54:23,743 424c35d3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 18:54:23,743 424c35d3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 18:54:23,748 424c35d3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 18:54:23,750 424c35d3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 18:54:23,776 424c35d3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 18:54:23,776 424c35d3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/424c35d3/pkb.log
2017-05-05 18:54:23,777 424c35d3 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/424c35d3/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #375
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/375/display/redirect?page=changes>
Changes:
[aljoscha.krettek] [BEAM-1862] SplittableDoFnOperator should close the
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3bffe0e0014bdd6ae73dc2e8ecfc2b61d066120c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3bffe0e0014bdd6ae73dc2e8ecfc2b61d066120c
> git rev-list 7903e59c4e07822f8def85ee6a7f8ef3ccb1ca7a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2417919858563827519.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7895987214291620795.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2766035856415306403.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5946974480346757738.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 12:00:18,732 d6d41712 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d6d41712/pkb.log
2017-05-05 12:00:18,732 d6d41712 MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 12:00:18,733 d6d41712 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 12:00:19,014 d6d41712 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 12:00:19,172 d6d41712 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 12:00:19,176 d6d41712 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 12:00:19,177 d6d41712 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 12:00:19,185 d6d41712 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 12:00:19,187 d6d41712 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 12:00:19,240 d6d41712 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 12:00:19,240 d6d41712 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d6d41712/pkb.log
2017-05-05 12:00:19,240 d6d41712 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/d6d41712/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #374
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/374/display/redirect?page=changes>
Changes:
[klk] Move Java sdk.util.state to sdk.state
[klk] Add @Internal and @Experimental to state package
[klk] Move user-facing timer-related classes out of util
[klk] Mark TimeDomain experimental alongside Timers; improve javadoc
[klk] Move WindowingStrategy from util to values
[klk] Move PathValidator adjacent to other filesystem bits
[klk] Move SideInputReader to runners/core-java
[klk] Move Reshuffle and ReshuffleTrigger out of util
[klk] Move ValueWithRecordId to sdk.values, annotated
[klk] Move some PCollectionView bits out of util
[klk] Update Dataflow worker to 20170504-2
[tgroh] Update expectation in ProcessBundleHandlerTest
[dhalperi] [BEAM-1871] Move out test only utilities used only in examples/java out
[dhalperi] Revert "This closes #2905"
[klk] Adjust error message expectation in DoFnSignaturesTest
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 7903e59c4e07822f8def85ee6a7f8ef3ccb1ca7a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 7903e59c4e07822f8def85ee6a7f8ef3ccb1ca7a
> git rev-list 2f4dd8dfaf9e94ff2a1f97edc695fbcd75be34cd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7538084356404224735.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4042714355130252232.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson426470528539862612.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4859371696513139763.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 06:00:18,988 fd9fd549 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/fd9fd549/pkb.log
2017-05-05 06:00:18,988 fd9fd549 MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 06:00:18,989 fd9fd549 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 06:00:19,229 fd9fd549 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 06:00:19,314 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 06:00:20,165 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 06:00:20,165 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 06:00:20,170 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 06:00:20,172 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 06:00:20,203 fd9fd549 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 06:00:20,204 fd9fd549 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/fd9fd549/pkb.log
2017-05-05 06:00:20,204 fd9fd549 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/fd9fd549/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #373
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/373/display/redirect?page=changes>
Changes:
[dhalperi] GCP-IO: manage versions in top level pom
[dhalperi] Remove IOChannelUtil/Factory from BigQueryIO
[klk] Eliminate Pipeline.getOptions
[robertwb] Cleanup old cython files before testing again
[klk] [BEAM-1727] Add align and offset to Timer
[klk] Fix initial watermark of DoFnOperator in Flink runner
[dhalperi] [BEAM-59] Remove IOChannelUtils, IOChannelFactory
[dhalperi] Move thrown.expect to correct place
[tgroh] Note when checkpoints may be committed.
[tgroh] Split StartBundleContext and FinishBundleContext
[kirpichov] [BEAM-2170] PubsubMessageWithAttributesCoder should not NPE on messages
[kirpichov] Makes PubsubMessagePayloadOnlyCoder not require whole-stream context
[kirpichov] Moves coder choice into PubsubSource
[davor] [BEAM-2144] Remove transform.reflect and utils from Javadocs
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2f4dd8dfaf9e94ff2a1f97edc695fbcd75be34cd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2f4dd8dfaf9e94ff2a1f97edc695fbcd75be34cd
> git rev-list b73918b55ab06e5a47ef9dc33ae3dbaebaed330a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson227170201862895542.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5916819713713284246.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5309455617960359779.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7566161025314604258.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 00:00:58,427 4a3fc96e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/4a3fc96e/pkb.log
2017-05-05 00:00:58,465 4a3fc96e MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 00:00:58,465 4a3fc96e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 00:00:59,060 4a3fc96e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 00:00:59,163 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 00:00:59,165 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 00:00:59,166 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 00:00:59,170 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 00:00:59,172 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 00:00:59,200 4a3fc96e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 00:00:59,201 4a3fc96e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/4a3fc96e/pkb.log
2017-05-05 00:00:59,201 4a3fc96e MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/4a3fc96e/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #372
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/372/display/redirect?page=changes>
Changes:
[klk] Annotate internal methods of PCollection
[klk] Annotate internal pieces of sdks.transforms
[klk] Tighten access control and internal annotations for triggers
[klk] The transforms.reflect package is not for users
[klk] Annotate internal-only bits of Java sdk.runners
[klk] Tighten access in sdk.options
[klk] Annotate internal methods on Pipeline
[lcwik] [BEAM-2165] Update Apex to support serializing/deserializing custom user
[lcwik] [BEAM-2165] Update Dataflow to support serializing/deserializing custom
[lcwik] [BEAM-2165] Update Flink to support serializing/deserializing custom
[lcwik] [BEAM-1871] Migrate ReleaseInfo away from Google API client GenericJson
[dhalperi] DataflowRunner: integration test GCP-IO
[lcwik] [BEAM-1491]Identify HADOOP_CONF_DIR(or YARN_CONF_DIR) environment
[lcwik] Split Coder's encode/decode methods into two methods depending on
[dhalperi] [BEAM-2162] Add logging to long BigQuery jobs
[tgroh] Use BinaryCombineLongFn in GroupIntoBatches
[altay] [BEAM-2152] Remove gcloud auth as application default credentials does
[dhalperi] AvroIOTest: stop using IOChannelUtils, remove invalid test
[dhalperi] DataflowRunner: switch from IOChannels to FileSystems for creating files
[dhalperi] DataflowPipelineOptions: use FileSystems, not IOChannelUtils, to resolve
[dhalperi] Stop registering IOChannelFactories in SDK harness, runners, tests
[dhalperi] FileSystems: add match(String) for single spec
[dhalperi] WriteWithShardingFactoryTest: switch to FileSystems
[dhalperi] ReadTranslator: remove outdated comment
[dhalperi] TFRecordIO: switch to FileSystems from IOChannelUtils
[lcwik] Remove POutput#recordAsOutput
[robertwb] One more TaggedOutput name change.
[dhalperi] Update JavaDoc of checkpoint, and expose `enable.auto.commit` for more
[lcwik] Use CloudObject encodings in the Beam Fn Harness
[aviemzur] [BEAM-1763] Verify PAssert execution in runners which support metrics.
[aviemzur] [BEAM-1726] Fix empty side inputs in Flink Streaming Runner
[aviemzur] [BEAM-1726] Fix RuntimeException throwing in FlinkStateInternals
[aviemzur] [BEAM-1726] Fix Flatten with input copies in Flink Streaming Runner
[aviemzur] [BEAM-1763] Replace usage of PipelineRule with TestPipeline in Spark
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam2 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b73918b55ab06e5a47ef9dc33ae3dbaebaed330a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b73918b55ab06e5a47ef9dc33ae3dbaebaed330a
> git rev-list ff6bb353002610169a8079d1164118606bebb21e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8302199996735440149.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6393172615410736925.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4182315741520362001.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2998196018294298494.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 18:18:28,736 8fcb4f87 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/8fcb4f87/pkb.log
2017-05-04 18:18:28,736 8fcb4f87 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 18:18:28,737 8fcb4f87 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 18:18:29,449 8fcb4f87 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 18:18:29,614 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 18:18:29,617 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 18:18:29,617 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 18:18:29,624 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 18:18:29,627 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 18:18:29,681 8fcb4f87 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 18:18:29,682 8fcb4f87 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/8fcb4f87/pkb.log
2017-05-04 18:18:29,682 8fcb4f87 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/8fcb4f87/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #371
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/371/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ff6bb353002610169a8079d1164118606bebb21e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ff6bb353002610169a8079d1164118606bebb21e
> git rev-list ff6bb353002610169a8079d1164118606bebb21e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1079305215059373945.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson400584237070228302.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6782621028537445695.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2869572068032251778.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 12:01:19,146 397f971b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/397f971b/pkb.log
2017-05-04 12:01:19,147 397f971b MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 12:01:19,147 397f971b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 12:01:19,263 397f971b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 12:01:19,350 397f971b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 12:01:19,352 397f971b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 12:01:19,352 397f971b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 12:01:19,358 397f971b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 12:01:19,360 397f971b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 12:01:19,386 397f971b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 12:01:19,386 397f971b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/397f971b/pkb.log
2017-05-04 12:01:19,386 397f971b MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/397f971b/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #370
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/370/display/redirect?page=changes>
Changes:
[dhalperi] Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems
[tgroh] Inline TypedPValue
[lcwik] [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions
[kirpichov] Provides a default coder for PubsubMessage
[kirpichov] Moves PubsubMessage to upper level and renames payload
[klk] BigQueryIO: Remove tempLocation usage at pipeline construction time
[dhalperi] Removal of Aggregator class. Also removal from comments.
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ff6bb353002610169a8079d1164118606bebb21e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ff6bb353002610169a8079d1164118606bebb21e
> git rev-list b4bafd09282cf66adf121b750d3e2d9e5a0fefbe # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1444438434785476686.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7081035498281775005.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2859973814943599527.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7637998100796022197.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 06:00:42,550 b7a79798 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b7a79798/pkb.log
2017-05-04 06:00:42,550 b7a79798 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 06:00:42,550 b7a79798 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 06:00:42,855 b7a79798 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 06:00:42,964 b7a79798 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 06:00:42,966 b7a79798 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 06:00:42,967 b7a79798 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 06:00:42,972 b7a79798 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 06:00:42,974 b7a79798 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 06:00:43,001 b7a79798 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 06:00:43,002 b7a79798 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b7a79798/pkb.log
2017-05-04 06:00:43,002 b7a79798 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/b7a79798/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #369
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/369/display/redirect?page=changes>
Changes:
[klk] Use Thread context ClassLoader as parent in AvroCoderTest
[tgroh] Mark all PCollectionView methods internal
[lcwik] [BEAM-1871] Move GCP specific serialization CloudObject and supporting
[tgroh] Reduce visibility of DirectRunner classes
[altay] Retry on correct error codes for datastoreio
[robertwb] Try PTransform-based coder inference before using fallback coder.
[robertwb] Fix coder inference ambiguity in CombineFnsTest.
[klk] Remove job name usages from BigQueryIO at pipeline construction time
[kirpichov] Fully general dynamic tables (including schemas) in BigQueryIO.
[kirpichov] Fixes PubsubIO.Write translation in Dataflow runner
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam2 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b4bafd09282cf66adf121b750d3e2d9e5a0fefbe (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b4bafd09282cf66adf121b750d3e2d9e5a0fefbe
> git rev-list 0d19d3cb210ef179e1831b971f7cf6d3d6bb1dde # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson197114110450717999.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2867269520771524429.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4022959279102052127.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1410710530977960850.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 00:03:05,091 822da785 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/822da785/pkb.log
2017-05-04 00:03:05,093 822da785 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 00:03:05,094 822da785 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 00:03:05,598 822da785 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 00:03:05,733 822da785 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 00:03:05,736 822da785 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 00:03:05,736 822da785 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 00:03:05,748 822da785 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 00:03:05,750 822da785 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 00:03:05,803 822da785 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 00:03:05,804 822da785 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/822da785/pkb.log
2017-05-04 00:03:05,804 822da785 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/822da785/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #368
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/368/display/redirect?page=changes>
Changes:
[klk] Use LinkedHashMap for step contexts in BaseExecutionContext
[dhalperi] Remove IoChannelUtils from PackageUtil
[dhalperi] [BEAM-59] FileChecksumMatcherTest: switch from IOChannelUtils to java
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0d19d3cb210ef179e1831b971f7cf6d3d6bb1dde (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 0d19d3cb210ef179e1831b971f7cf6d3d6bb1dde
> git rev-list 3b61f6a9034b3dbb8b08f695b7b526656660c8a6 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8822402256232841916.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6143726776491349836.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5896650652856289214.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3659993746409279566.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 18:04:37,849 33130c4f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/33130c4f/pkb.log
2017-05-03 18:04:37,849 33130c4f MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 18:04:37,850 33130c4f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 18:04:38,526 33130c4f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 18:04:38,662 33130c4f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 18:04:38,664 33130c4f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 18:04:38,665 33130c4f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 18:04:38,673 33130c4f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 18:04:38,676 33130c4f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 18:04:38,709 33130c4f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 18:04:38,709 33130c4f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/33130c4f/pkb.log
2017-05-03 18:04:38,710 33130c4f MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/33130c4f/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #367
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/367/display/redirect?page=changes>
Changes:
[vikasrk] Triggers for Java SDK post submit tests
[kirpichov] Removed coder and parseFn from PubsubIO.Read
[kirpichov] Removed coder and formatFn from PubsubIO.Write
[kirpichov] Introduces read/writePubsubMessages
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3b61f6a9034b3dbb8b08f695b7b526656660c8a6 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3b61f6a9034b3dbb8b08f695b7b526656660c8a6
> git rev-list dc0fdcb7e62067fdc629b8558659fce7e37e4856 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5223032132045342938.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3069112977640495240.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2562948682559758564.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4871808138669294515.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 12:00:18,040 00eb0167 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/00eb0167/pkb.log
2017-05-03 12:00:18,041 00eb0167 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 12:00:18,041 00eb0167 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 12:00:18,338 00eb0167 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 12:00:18,436 00eb0167 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 12:00:18,439 00eb0167 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 12:00:18,439 00eb0167 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 12:00:18,445 00eb0167 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 12:00:18,448 00eb0167 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 12:00:18,467 00eb0167 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 12:00:18,468 00eb0167 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/00eb0167/pkb.log
2017-05-03 12:00:18,468 00eb0167 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/00eb0167/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #366
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/366/display/redirect?page=changes>
Changes:
[robertwb] Deprecate <pipeline>.options usage
[lcwik] Remove Coder.asCloudObject and related methods
[altay] Updating Dataflow API protos and client
[tgroh] Add Additional CloudObjectTranslators
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision dc0fdcb7e62067fdc629b8558659fce7e37e4856 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f dc0fdcb7e62067fdc629b8558659fce7e37e4856
> git rev-list 3bb0f8e6ad8a2b378a656731732a79c9c16e4a8d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4609501167634798019.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9117219116175138012.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson380355071913316710.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6791561348024361129.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 06:00:33,733 714e3efe MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/714e3efe/pkb.log
2017-05-03 06:00:33,733 714e3efe MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 06:00:33,734 714e3efe MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 06:00:33,998 714e3efe MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 06:00:34,082 714e3efe MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 06:00:34,084 714e3efe MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 06:00:34,085 714e3efe MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 06:00:34,090 714e3efe MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 06:00:34,092 714e3efe MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 06:00:34,119 714e3efe MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 06:00:34,119 714e3efe MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/714e3efe/pkb.log
2017-05-03 06:00:34,120 714e3efe MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/714e3efe/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #365
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/365/display/redirect?page=changes>
Changes:
[klk] Use processing time for synchronized processing time in Flink runner
[klk] Simplify type parameters of StateSpec and related
[klk] Make DoFnSignatures robust to StateSpec subclasses
[kirpichov] Removes leftover no-op withoutValidation methods
[kirpichov] Removes TextIO.Read.Bound
[kirpichov] Converts TextIO.Read to AutoValue
[kirpichov] Removes TextIO.Write.Bound
[kirpichov] Converts TextIO.Write to AutoValue
[kirpichov] Moves TextSource and TextSink to top level
[lcwik] [BEAM-2135] Move hdfs to hadoop-file-system
[dhalperi] [BEAM-2141] Disable JDBC tests
[dhalperi] BigQuery: swap from asSingleton to asIterable for Cleanup
[lcwik] [BEAM-2020] Convert all unknown Coders into CustomCoder CloudObjects
[chamikara] [BEAM-539] Fixes several issues of FileSink.
[altay] [BEAM-1316] Remove the usage of mock from ptransform tests
[lcwik] [BEAM-2135] Fix pointers to GCP-core
[klk] Skip null options when converting back to argv
[klk] Instantiate runner briefly in Pipeline
[lcwik] [BEAM-2135] Fix pointers to sdks/java/io/hadoop-file-system
[davor] [BEAM-2093] Use the jackson version from the maven property in maven
[dhalperi] [BEAM-59] Delete old restrictions on output file paths
[lcwik] [BEAM-2139] Disable SplittableDoFn ValidatesRunner tests for Streaming
[dhalperi] [BEAM-59] Move GcsFileSystem to gcp-core
[dhalperi] Full removal of Aggregators in Java SDK and Runners
[davor] Include LICENSE and NOTICE in python dist files
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3bb0f8e6ad8a2b378a656731732a79c9c16e4a8d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3bb0f8e6ad8a2b378a656731732a79c9c16e4a8d
> git rev-list eec903fb538eb9c3d41d737dba94a41f7c1c469e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4423006436169070601.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5338004820536756484.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1500182718279178360.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5189078248202599501.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 00:02:38,285 bc160be8 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bc160be8/pkb.log
2017-05-03 00:02:38,285 bc160be8 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 00:02:38,286 bc160be8 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 00:02:38,833 bc160be8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 00:02:38,932 bc160be8 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 00:02:38,934 bc160be8 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 00:02:38,934 bc160be8 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 00:02:38,939 bc160be8 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 00:02:38,941 bc160be8 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 00:02:38,962 bc160be8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 00:02:38,963 bc160be8 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bc160be8/pkb.log
2017-05-03 00:02:38,963 bc160be8 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/bc160be8/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #364
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/364/display/redirect?page=changes>
Changes:
[wtanaka] Add comments to Trigger.java
[iemejia] [BEAM-1764] Remove aggregators from Flink Runner
[davor] Update github PR template after travis removal.
[altay] Add retry logic for job creation
[tgroh] Add an @Internal Annotation
[robertwb] Revert clean else-return lint changes.
[lcwik] [BEAM-2135] Move gcp-core to google-cloud-platform-core
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam4 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:809)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1076)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1107)
at hudson.scm.SCM.checkout(SCM.java:496)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1281)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1728)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:405)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*" returned status code 128:
stdout:
stderr: error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision eec903fb538eb9c3d41d737dba94a41f7c1c469e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f eec903fb538eb9c3d41d737dba94a41f7c1c469e
> git rev-list ae72456b7125a28f2db4b8dad2990b2bb063ca9b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8706026561929483622.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson425751425269746362.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4441358561143021270.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1024427901516202230.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 18:25:21,716 554ad8e1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/554ad8e1/pkb.log
2017-05-02 18:25:21,718 554ad8e1 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 18:25:21,719 554ad8e1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 18:25:22,240 554ad8e1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 18:25:22,450 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 18:25:22,454 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 18:25:22,454 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 18:25:22,462 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 18:25:22,465 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 18:25:22,509 554ad8e1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 18:25:22,510 554ad8e1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/554ad8e1/pkb.log
2017-05-02 18:25:22,510 554ad8e1 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/554ad8e1/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #363
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/363/display/redirect?page=changes>
Changes:
[dhalperi] Remove Aggregators from StatefulDoFn runner
[dhalperi] Removing Aggregator from core runner code
[dhalperi] Remove accumulators from DoFn tester.
[jbonofre] Remove unneeded elements from the POM files
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ae72456b7125a28f2db4b8dad2990b2bb063ca9b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ae72456b7125a28f2db4b8dad2990b2bb063ca9b
> git rev-list e92ead58cd661ff7ee952278f2983a578bdd2412 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8808595505571951135.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5575995026223943279.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4231598413718564875.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4168573447482597019.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 12:00:25,291 c5c7fb81 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c5c7fb81/pkb.log
2017-05-02 12:00:25,291 c5c7fb81 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 12:00:25,292 c5c7fb81 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 12:00:25,623 c5c7fb81 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 12:00:25,715 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 12:00:25,717 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 12:00:25,718 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 12:00:25,723 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 12:00:25,726 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 12:00:25,746 c5c7fb81 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 12:00:25,746 c5c7fb81 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c5c7fb81/pkb.log
2017-05-02 12:00:25,747 c5c7fb81 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/c5c7fb81/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #362
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/362/display/redirect?page=changes>
Changes:
[robertwb] Fn API support for Python.
[robertwb] Rename OutputValue to TaggedOutput.
[lcwik] Copy CloudObject to the Dataflow Module
[lcwik] [BEAM-1871] Remove deprecated org.apache.beam.sdk.options.GcsOptions
[kirpichov] Fixes javadoc of TextIO to not point to AvroIO
[kirpichov] Moves AvroSink to upper level
[kirpichov] Removes AvroIO.Read.Bound
[kirpichov] Adds AvroIO.readGenericRecords()
[kirpichov] Converts AvroIO.Read to AutoValue
[kirpichov] Removes AvroIO.Write.Bound
[kirpichov] Moves AvroIO.Read.withSchema into read()
[kirpichov] Converts AvroIO.Write to AutoValue; adds writeGenericRecords()
[kirpichov] Moves AvroIO.write().withSchema into write()
[kirpichov] Scattered minor improvements per review comments
[dhalperi] maptask_executor_runner_test: build fix
[lcwik] [BEAM-2005, BEAM-2030, BEAM-2031, BEAM-2032, BEAM-2033, BEAM-2070] Base
[lcwik] [BEAM-2005] Fix build break, ignore test due to change in
[lcwik] Remove aggregators from DoFn contexts and internal SDK usage
[dhalperi] [BEAM-59] Core tests: stop using gs:// paths
[dhalperi] [BEAM-59] TFRecordIOTest: cleanup
[dhalperi] [BEAM-59] DataflowRunnerTests: configure FileSystems in test
[dhalperi] [BEAM-59] AvroIOTest: use absolute paths for display data
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e92ead58cd661ff7ee952278f2983a578bdd2412 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e92ead58cd661ff7ee952278f2983a578bdd2412
> git rev-list b8131fe935d00db7f760b6410a4eb2239db1d25a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7353765744138912579.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5378899830644152793.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3104503862056589697.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6892438915894804756.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 06:00:32,557 3603e1c1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3603e1c1/pkb.log
2017-05-02 06:00:32,558 3603e1c1 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 06:00:32,558 3603e1c1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 06:00:32,904 3603e1c1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 06:00:32,994 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 06:00:32,997 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 06:00:32,997 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 06:00:33,002 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 06:00:33,004 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 06:00:33,031 3603e1c1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 06:00:33,032 3603e1c1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3603e1c1/pkb.log
2017-05-02 06:00:33,032 3603e1c1 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/3603e1c1/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #361
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/361/display/redirect?page=changes>
Changes:
[klk] Do not repeat log messages in DataflowPipelineJob
[tgroh] Add A CoderTranslator Interface
[lcwik] Re-enable WindowedWordCountIT on Flink runner in precommit
[tgroh] Add Cloud Object Translators for Coders
[dhalperi] [BEAM-1676] Internalize ClassPath from Guava 21.0 to fix the failures
[lcwik] [BEAM-1871] Hide CloudResourceManager client in
[chamikara] [BEAM-1925] Remove deprecated context param from DoFn
[dhalperi] Remove IOChannelUtils from BigQuery TableRowWriter
[dhalperi] [BEAM-59] Switch mimeType from mutable protected field to constructor
[lcwik] Add CloudObjectTranslators for Avro, Serializable
[altay] [BEAM-1441] remove manual join from apiclient
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:809)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1076)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1107)
at hudson.scm.SCM.checkout(SCM.java:496)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1281)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1728)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:405)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*" returned status code 128:
stdout:
stderr: error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam1(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b8131fe935d00db7f760b6410a4eb2239db1d25a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b8131fe935d00db7f760b6410a4eb2239db1d25a
> git rev-list fe2a32000be87bbed1e8ae5a81a8e0368f0b0234 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6960404443284401470.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6555700586416662445.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6545264446819990109.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3892156480876229696.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 00:05:08,036 b3752e07 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b3752e07/pkb.log
2017-05-02 00:05:08,036 b3752e07 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 00:05:08,036 b3752e07 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 00:05:08,480 b3752e07 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 00:05:08,569 b3752e07 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 00:05:08,571 b3752e07 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 00:05:08,572 b3752e07 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 00:05:08,577 b3752e07 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 00:05:08,586 b3752e07 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 00:05:08,605 b3752e07 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 00:05:08,605 b3752e07 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b3752e07/pkb.log
2017-05-02 00:05:08,606 b3752e07 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/b3752e07/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #360
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/360/display/redirect?page=changes>
Changes:
[staslevin] [BEAM-2074,BEAM-2073] Fixed SourceDStream's rate control usage.
[lcwik] Use a new ReflectData for each AvroCoder instance
[lcwik] [BEAM-2130] Ensure the options id is never null.
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fe2a32000be87bbed1e8ae5a81a8e0368f0b0234 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fe2a32000be87bbed1e8ae5a81a8e0368f0b0234
> git rev-list 254470e626edb6a013ba5cb2d3312dc3bfbdcb51 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7363877203267415167.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5694443500676162576.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2268732869890752569.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7788084381097802984.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 18:00:12,066 e7cfe82e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/e7cfe82e/pkb.log
2017-05-01 18:00:12,066 e7cfe82e MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-01 18:00:12,066 e7cfe82e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 18:00:12,193 e7cfe82e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 18:00:12,280 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 18:00:12,282 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 18:00:12,282 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 18:00:12,288 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 18:00:12,290 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 18:00:12,316 e7cfe82e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 18:00:12,317 e7cfe82e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/e7cfe82e/pkb.log
2017-05-01 18:00:12,317 e7cfe82e MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/e7cfe82e/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #359
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/359/display/redirect?page=changes>
Changes:
[aviemzur] [BEAM-2129] Fix flaky KafkaIOTest#testUnboundedSourceMetrics
[staslevin] [BEAM-2072] Fixed MicrobatchSource.reader stops reading after reaching
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 254470e626edb6a013ba5cb2d3312dc3bfbdcb51 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 254470e626edb6a013ba5cb2d3312dc3bfbdcb51
> git rev-list 1197bef19b3ef974cdab39bd0468050586f17649 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6152341388469165452.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5067099177971037270.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6554058786833359081.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4784823925227759670.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 12:00:10,272 8eb5fb9e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/8eb5fb9e/pkb.log
2017-05-01 12:00:10,272 8eb5fb9e MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-05-01 12:00:10,273 8eb5fb9e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 12:00:10,444 8eb5fb9e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 12:00:10,554 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 12:00:10,556 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 12:00:10,557 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 12:00:10,562 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 12:00:10,564 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 12:00:10,585 8eb5fb9e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 12:00:10,585 8eb5fb9e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/8eb5fb9e/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #358
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/358/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Minor style cleanups to WriteOneWindowPerFile
[klk] Remove KeyedCombineFn
[klk] Update Dataflow worker version to beam-master-20170430
[dhalperi] [BEAM-59] DataflowRunner: Sink is always a FileBasedSink now
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1197bef19b3ef974cdab39bd0468050586f17649 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1197bef19b3ef974cdab39bd0468050586f17649
> git rev-list 46ca02aba5f4453b636e1c3eb799fca66cef9cfc # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7071712309772056122.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5333494622897297169.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5714470993083099562.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7610602714037543274.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 06:00:10,077 0ad3ea50 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/0ad3ea50/pkb.log
2017-05-01 06:00:10,077 0ad3ea50 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-05-01 06:00:10,078 0ad3ea50 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 06:00:10,272 0ad3ea50 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 06:00:10,358 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 06:00:10,360 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 06:00:10,360 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 06:00:10,366 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 06:00:10,368 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 06:00:10,393 0ad3ea50 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 06:00:10,393 0ad3ea50 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/0ad3ea50/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #357
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/357/display/redirect?page=changes>
Changes:
[dhalperi] Do not prune branches in Jenkins
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 46ca02aba5f4453b636e1c3eb799fca66cef9cfc (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 46ca02aba5f4453b636e1c3eb799fca66cef9cfc
> git rev-list a19ceaf47cbf6adddd755ee523141c88bbc53f05 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3701123732946005273.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8305364138761762006.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4622022496640876743.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4157783115163909445.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 00:00:09,649 dd94e0d2 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/dd94e0d2/pkb.log
2017-05-01 00:00:09,649 dd94e0d2 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-05-01 00:00:09,650 dd94e0d2 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 00:00:10,307 dd94e0d2 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 00:00:10,390 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 00:00:10,397 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 00:00:10,398 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 00:00:10,404 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 00:00:10,446 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 00:00:10,477 dd94e0d2 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 00:00:10,478 dd94e0d2 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/dd94e0d2/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #356
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/356/display/redirect?page=changes>
Changes:
[thw] BEAM-2022 fix triggering for processing time timers
[kirpichov] [BEAM-2114] Fixed display data for Kafka read/write with coders
[kirpichov] [BEAM-2114] Throw instead of warning when KafkaIO cannot infer coder
[kirpichov] [BEAM-2114] Tests for KafkaIO: use ExpectedException rule
[iemejia] Fix hamcrest-core version in parent pom
------------------------------------------
[...truncated 244.20 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a19ceaf47cbf6adddd755ee523141c88bbc53f05 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a19ceaf47cbf6adddd755ee523141c88bbc53f05
> git rev-list fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1845648802584385833.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5289481183229827751.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5305735820570203269.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3437877643927861753.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 18:03:08,543 a3d92479 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/a3d92479/pkb.log
2017-04-30 18:03:08,543 a3d92479 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 18:03:08,544 a3d92479 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 18:03:09,001 a3d92479 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 18:03:09,092 a3d92479 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 18:03:09,094 a3d92479 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 18:03:09,095 a3d92479 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 18:03:09,100 a3d92479 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 18:03:09,102 a3d92479 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 18:03:09,126 a3d92479 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 18:03:09,127 a3d92479 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/a3d92479/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #355
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/355/display/redirect>
------------------------------------------
[...truncated 275.61 KB...]
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
* [new ref] refs/pull/2783/head -> origin/pr/2783/head
* [new ref] refs/pull/2783/merge -> origin/pr/2783/merge
* [new ref] refs/pull/2784/head -> origin/pr/2784/head
* [new ref] refs/pull/2784/merge -> origin/pr/2784/merge
* [new ref] refs/pull/2785/head -> origin/pr/2785/head
* [new ref] refs/pull/2785/merge -> origin/pr/2785/merge
* [new ref] refs/pull/2786/head -> origin/pr/2786/head
* [new ref] refs/pull/2786/merge -> origin/pr/2786/merge
* [new ref] refs/pull/2787/head -> origin/pr/2787/head
* [new ref] refs/pull/2787/merge -> origin/pr/2787/merge
* [new ref] refs/pull/2788/head -> origin/pr/2788/head
* [new ref] refs/pull/2788/merge -> origin/pr/2788/merge
* [new ref] refs/pull/2789/head -> origin/pr/2789/head
* [new ref] refs/pull/2789/merge -> origin/pr/2789/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fc55d2f811a57d25e8d1e5f204d9a07e2c50a370
> git rev-list fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7453968279601938384.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8885442801494115696.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6183792721343274824.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson510426867877615601.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 12:03:45,742 d2074a0c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d2074a0c/pkb.log
2017-04-30 12:03:45,742 d2074a0c MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 12:03:45,743 d2074a0c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 12:03:45,953 d2074a0c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 12:03:46,039 d2074a0c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 12:03:46,041 d2074a0c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 12:03:46,041 d2074a0c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 12:03:46,047 d2074a0c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 12:03:46,049 d2074a0c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 12:03:46,076 d2074a0c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 12:03:46,076 d2074a0c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d2074a0c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #354
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/354/display/redirect?page=changes>
Changes:
[lcwik] Remove useless return statement
[lcwik] Remove redundant private on enum constructors
[lcwik] Remove useless continue statements
------------------------------------------
[...truncated 279.34 KB...]
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
* [new ref] refs/pull/2783/head -> origin/pr/2783/head
* [new ref] refs/pull/2783/merge -> origin/pr/2783/merge
* [new ref] refs/pull/2784/head -> origin/pr/2784/head
* [new ref] refs/pull/2784/merge -> origin/pr/2784/merge
* [new ref] refs/pull/2785/head -> origin/pr/2785/head
* [new ref] refs/pull/2785/merge -> origin/pr/2785/merge
* [new ref] refs/pull/2786/head -> origin/pr/2786/head
* [new ref] refs/pull/2786/merge -> origin/pr/2786/merge
* [new ref] refs/pull/2787/head -> origin/pr/2787/head
* [new ref] refs/pull/2787/merge -> origin/pr/2787/merge
* [new ref] refs/pull/2788/head -> origin/pr/2788/head
* [new ref] refs/pull/2788/merge -> origin/pr/2788/merge
* [new ref] refs/pull/2789/head -> origin/pr/2789/head
* [new ref] refs/pull/2789/merge -> origin/pr/2789/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fc55d2f811a57d25e8d1e5f204d9a07e2c50a370
> git rev-list 14d60b26e7e9b8a578038599341e66ccd99d012b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6862909983330959471.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4580765514315349282.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5721452976460685433.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3975592660729805138.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 06:03:56,700 138e2101 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/138e2101/pkb.log
2017-04-30 06:03:56,700 138e2101 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 06:03:56,702 138e2101 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 06:03:57,053 138e2101 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 06:03:57,167 138e2101 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 06:03:57,169 138e2101 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 06:03:57,170 138e2101 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 06:03:57,177 138e2101 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 06:03:57,179 138e2101 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 06:03:57,197 138e2101 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 06:03:57,198 138e2101 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/138e2101/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #353
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/353/display/redirect?page=changes>
Changes:
[klk] Move stable name validation to Pipeline.run()
[klk] Remove PipelineOptions from createWriteOperation()
[klk] Move PTransform.validate to post-construction, modulo BigQueryIO
[klk] Supply PipelineOptions at Pipeline.run()
[kirpichov] Converts PubsubIO.Read to AutoValue
[kirpichov] Renames PubsubIO.Read builder methods to be style guide compliant
[kirpichov] Remove override of topic by subscription and vice versa
[kirpichov] Converts PubsubIO.Write to AutoValue
[kirpichov] Renames PubsubIO.Write builder methods to be style guide compliant
[kirpichov] Adds PubsubIO.readStrings(), readProtos(), readAvros()
[kirpichov] Adds PubsubIO.writeStrings(), writeProtos(), writeAvros()
[kirpichov] Renames {id,timestamp}Label to {id,timestamp}Attribute throughout SDK
------------------------------------------
[...truncated 277.08 KB...]
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
* [new ref] refs/pull/2783/head -> origin/pr/2783/head
* [new ref] refs/pull/2783/merge -> origin/pr/2783/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 14d60b26e7e9b8a578038599341e66ccd99d012b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 14d60b26e7e9b8a578038599341e66ccd99d012b
> git rev-list be883666f377b29926cc1e7408d7cd268ca6ceff # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8367195479928485348.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3089505677135875789.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3553683777749011579.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4294483275160305081.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 00:03:26,437 08e803bf MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/08e803bf/pkb.log
2017-04-30 00:03:26,437 08e803bf MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 00:03:26,438 08e803bf MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 00:03:26,562 08e803bf MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 00:03:26,655 08e803bf MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 00:03:26,658 08e803bf MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 00:03:26,658 08e803bf MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 00:03:26,665 08e803bf MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 00:03:26,668 08e803bf MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 00:03:26,684 08e803bf MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 00:03:26,685 08e803bf MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/08e803bf/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #352
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/352/display/redirect?page=changes>
Changes:
[aviemzur] Fix broken build
[aviemzur] [BEAM-2057] Add a test for metrics reporting in Spark runner.
[aviemzur] [BEAM-1398] KafkaIO metrics.
[lcwik] [BEAM-1871] Hide internal implementation details of how we create a
[lcwik] [BEAM-2098] Walkthrough URL in example code Javadoc is 404 not found
------------------------------------------
[...truncated 272.56 KB...]
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision be883666f377b29926cc1e7408d7cd268ca6ceff (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f be883666f377b29926cc1e7408d7cd268ca6ceff
> git rev-list 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4745471857012938703.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6358110927967500065.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8940889086758308405.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3378038771597517468.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 18:03:49,527 bb4cfe9b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bb4cfe9b/pkb.log
2017-04-29 18:03:49,527 bb4cfe9b MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 18:03:49,528 bb4cfe9b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 18:03:49,751 bb4cfe9b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 18:03:49,894 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 18:03:49,897 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 18:03:49,897 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 18:03:49,904 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 18:03:49,906 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 18:03:49,918 bb4cfe9b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 18:03:49,919 bb4cfe9b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bb4cfe9b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #351
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/351/display/redirect>
------------------------------------------
[...truncated 275.47 KB...]
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2781/merge -> origin/pr/2781/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7
> git rev-list 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5610768077729537594.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2140599300260081637.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3098636546658275577.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2183055372966426644.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 12:02:56,991 71421fca MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/71421fca/pkb.log
2017-04-29 12:02:56,992 71421fca MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 12:02:56,992 71421fca MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 12:02:57,205 71421fca MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 12:02:57,299 71421fca MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 12:02:57,302 71421fca MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 12:02:57,302 71421fca MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 12:02:57,309 71421fca MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 12:02:57,311 71421fca MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 12:02:57,333 71421fca MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 12:02:57,334 71421fca MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/71421fca/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #350
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/350/display/redirect?page=changes>
Changes:
[tgroh] Java-Serialize Coders Directly
[tgroh] Use Runner API Encodings in the Fn API
------------------------------------------
[...truncated 276.76 KB...]
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7
> git rev-list 8cc4d59c2f617746228ae71f7c9b3606ab41d4aa # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson575957050051838022.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4536196834838176277.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4461022084672753065.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2123489805330147213.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 06:03:00,455 12fcd3a7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/12fcd3a7/pkb.log
2017-04-29 06:03:00,455 12fcd3a7 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 06:03:00,455 12fcd3a7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 06:03:00,806 12fcd3a7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 06:03:00,893 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 06:03:00,896 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 06:03:00,896 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 06:03:00,903 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 06:03:00,905 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 06:03:00,928 12fcd3a7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 06:03:00,929 12fcd3a7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/12fcd3a7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #349
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/349/display/redirect?page=changes>
Changes:
[thw] BEAM-1981 Fix ApexTimerInternals serialization error.
[lcwik] [BEAM-2119] Fix FileSystems to have the local filesystem installed by
[dhalperi] ResourceId: Add #isDirectory
[dhalperi] TextIOTest: shrink size of test data
[dhalperi] Remove IOChannelUtils from a few ITs
[dhalperi] Use getFileName in NumberedShardedFile
[dhalperi] [BEAM-2114] Wrap inferred KafkaIO Coders with NullableCoder
[lcwik] [BEAM-2031] Add support to pass through zero or more Hadoop
[davor] Retire Travis-CI coverage in Apache Beam
[klk] Rollforwards "Replace OutputTimeFn UDF with TimestampCombiner enum""
[klk] Update Dataflow worker container to 20170428-2
[lcwik] [BEAM-2005] Swap to use Lists within MatchResult instead of arrays.
[tgroh] Rename StandardCoder to StructuredCoder
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam3 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8cc4d59c2f617746228ae71f7c9b3606ab41d4aa (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8cc4d59c2f617746228ae71f7c9b3606ab41d4aa
> git rev-list a8a04a2905e1ff639f403be7d9132acb77365e84 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8165256925489934285.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5977251568187376076.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7413298209517419532.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7237457073097871041.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 03:13:57,597 4369b025 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/4369b025/pkb.log
2017-04-29 03:13:57,597 4369b025 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 03:13:57,598 4369b025 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 03:13:58,134 4369b025 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 03:13:58,237 4369b025 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 03:13:58,240 4369b025 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 03:13:58,240 4369b025 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 03:13:58,246 4369b025 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 03:13:58,248 4369b025 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 03:13:58,253 4369b025 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 03:13:58,254 4369b025 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/4369b025/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #348
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/348/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-1871] Remove irrelevant runtime dependencies.
[lcwik] [BEAM-2005] Move getScheme from FileSystemRegistrar to FileSystem
[iemejia] Remove missing references to the flink examples package after refactor
[altay] [BEAM-2094] WordCount examples produce garbage for non-English input
[davor] Fix Javadoc warnings
[dhalperi] Add getFilename method to ResourceId
------------------------------------------
[...truncated 278.83 KB...]
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2765/merge -> origin/pr/2765/merge
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! c340815...7db1c72 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a8a04a2905e1ff639f403be7d9132acb77365e84 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a8a04a2905e1ff639f403be7d9132acb77365e84
> git rev-list 47aaf11250e61d61c0bb3616063dbd5b7f2adb88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4564722808097325418.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7314216211457396990.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2895089141881926520.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1619236758377138686.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 18:03:53,919 b587cc76 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b587cc76/pkb.log
2017-04-28 18:03:53,920 b587cc76 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 18:03:53,920 b587cc76 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 18:03:54,167 b587cc76 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 18:03:54,252 b587cc76 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 18:03:54,254 b587cc76 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 18:03:54,254 b587cc76 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 18:03:54,259 b587cc76 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 18:03:54,261 b587cc76 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 18:03:54,289 b587cc76 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 18:03:54,289 b587cc76 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b587cc76/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #347
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/347/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Remove IOChannelFactory usage from
------------------------------------------
[...truncated 274.58 KB...]
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 47aaf11250e61d61c0bb3616063dbd5b7f2adb88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 47aaf11250e61d61c0bb3616063dbd5b7f2adb88
> git rev-list 185dc47982078124abf6e851ad1c66ebc4ae8c54 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson237869347449738261.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1892242311269932473.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3470559880167990717.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9059110588875269546.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 12:03:03,070 d98aca1b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d98aca1b/pkb.log
2017-04-28 12:03:03,070 d98aca1b MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 12:03:03,071 d98aca1b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 12:03:03,431 d98aca1b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 12:03:03,519 d98aca1b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 12:03:03,522 d98aca1b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 12:03:03,522 d98aca1b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 12:03:03,527 d98aca1b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 12:03:03,529 d98aca1b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 12:03:03,553 d98aca1b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 12:03:03,553 d98aca1b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d98aca1b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #346
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/346/display/redirect?page=changes>
Changes:
[dhalperi] WriteFiles: trivial message fix
[altay] Add a simple snippet for a composite transform.
[lcwik] [BEAM-2031] Add support to PipelineOptionsFactory/ProxyInvocationHandler
------------------------------------------
[...truncated 278.41 KB...]
* [new ref] refs/pull/2687/merge -> origin/pr/2687/merge
* [new ref] refs/pull/2688/head -> origin/pr/2688/head
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 185dc47982078124abf6e851ad1c66ebc4ae8c54 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 185dc47982078124abf6e851ad1c66ebc4ae8c54
> git rev-list f71395bfd8f94cbe8d78098f5bb66a1dce65e74b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7629065342476446863.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5164883115491144609.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5434082747574129193.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3907632445143274954.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 06:03:23,260 b10f0b95 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b10f0b95/pkb.log
2017-04-28 06:03:23,261 b10f0b95 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 06:03:23,261 b10f0b95 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 06:03:23,893 b10f0b95 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 06:03:23,993 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 06:03:23,996 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 06:03:23,996 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 06:03:24,001 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 06:03:24,003 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 06:03:24,032 b10f0b95 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 06:03:24,032 b10f0b95 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b10f0b95/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #345
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/345/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] LocalResources: helper utility to create LocalResourceId
------------------------------------------
[...truncated 335.14 KB...]
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2755/merge -> origin/pr/2755/merge
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! 33b68a2...f9612e3 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 7129de6...0d9a8ae refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/871/merge: No such file or directory
! 61f4dd5...dcc5b0b refs/pull/871/merge -> origin/pr/871/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/886/merge: No such file or directory
! 01f16da...9fe583c refs/pull/886/merge -> origin/pr/886/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! c0c0a26...c340815 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/902/merge: No such file or directory
! 38d7315...824f162 refs/pull/902/merge -> origin/pr/902/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/914/merge: No such file or directory
! 3c4444a...b93dd41 refs/pull/914/merge -> origin/pr/914/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/917/merge: No such file or directory
! 7db5e68...b264c75 refs/pull/917/merge -> origin/pr/917/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/959/merge: No such file or directory
! 39c9afa...25d5f19 refs/pull/959/merge -> origin/pr/959/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/984/merge: No such file or directory
! 54fa2a8...da83b57 refs/pull/984/merge -> origin/pr/984/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f71395bfd8f94cbe8d78098f5bb66a1dce65e74b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f71395bfd8f94cbe8d78098f5bb66a1dce65e74b
> git rev-list a46eb1a80074dc9c382da4d71725ffc61f2e65ba # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8414838313204931955.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2274779365146555086.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson126783067219510162.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1619822904534489164.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 00:16:41,181 3baf5fc3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3baf5fc3/pkb.log
2017-04-28 00:16:41,181 3baf5fc3 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 00:16:41,182 3baf5fc3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 00:16:41,459 3baf5fc3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 00:16:41,579 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 00:16:41,581 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 00:16:41,582 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 00:16:41,588 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 00:16:41,590 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 00:16:41,616 3baf5fc3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 00:16:41,616 3baf5fc3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3baf5fc3/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #344
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/344/display/redirect?page=changes>
Changes:
[tgroh] Remove Coder Encoding IDs
[dhalperi] [BEAM-2029] NullPointerException when using multi output ParDo in Spark
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a46eb1a80074dc9c382da4d71725ffc61f2e65ba (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a46eb1a80074dc9c382da4d71725ffc61f2e65ba
> git rev-list 14a90d7c5196d96de66e897687d28202d790439f # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8954828005480798397.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7600906786718259233.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7565460630655822730.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2039476742967189830.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 23:08:54,432 1990bb3b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/1990bb3b/pkb.log
2017-04-27 23:08:54,433 1990bb3b MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 23:08:54,433 1990bb3b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 23:08:54,782 1990bb3b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 23:08:54,892 1990bb3b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 23:08:54,894 1990bb3b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 23:08:54,894 1990bb3b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 23:08:54,899 1990bb3b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 23:08:54,906 1990bb3b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 23:08:54,926 1990bb3b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 23:08:54,927 1990bb3b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/1990bb3b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #343
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/343/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Add FileSystems#matchNewResource
------------------------------------------
[...truncated 226.76 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam7(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 14a90d7c5196d96de66e897687d28202d790439f (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 14a90d7c5196d96de66e897687d28202d790439f
> git rev-list fdf2de9994268f5e1d704aa30a4504ac6ee624b8 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2015906685247531260.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6969306375109267709.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2093116221770561675.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7146861158317934605.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 22:00:01,523 b1eb7fb8 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b1eb7fb8/pkb.log
2017-04-27 22:00:01,523 b1eb7fb8 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 22:00:01,524 b1eb7fb8 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 22:00:01,704 b1eb7fb8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 22:00:01,830 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 22:00:01,834 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 22:00:01,834 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 22:00:01,842 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 22:00:01,846 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 22:00:01,915 b1eb7fb8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 22:00:01,916 b1eb7fb8 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b1eb7fb8/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #342
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/342/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-2096] Make DataflowMetrics more resilient
------------------------------------------
[...truncated 272.22 KB...]
* [new ref] refs/pull/2671/merge -> origin/pr/2671/merge
* [new ref] refs/pull/2672/head -> origin/pr/2672/head
* [new ref] refs/pull/2673/head -> origin/pr/2673/head
* [new ref] refs/pull/2673/merge -> origin/pr/2673/merge
* [new ref] refs/pull/2674/head -> origin/pr/2674/head
* [new ref] refs/pull/2675/head -> origin/pr/2675/head
* [new ref] refs/pull/2676/head -> origin/pr/2676/head
* [new ref] refs/pull/2676/merge -> origin/pr/2676/merge
* [new ref] refs/pull/2677/head -> origin/pr/2677/head
* [new ref] refs/pull/2678/head -> origin/pr/2678/head
* [new ref] refs/pull/2678/merge -> origin/pr/2678/merge
* [new ref] refs/pull/2679/head -> origin/pr/2679/head
* [new ref] refs/pull/2679/merge -> origin/pr/2679/merge
* [new ref] refs/pull/2680/head -> origin/pr/2680/head
* [new ref] refs/pull/2680/merge -> origin/pr/2680/merge
* [new ref] refs/pull/2681/head -> origin/pr/2681/head
* [new ref] refs/pull/2681/merge -> origin/pr/2681/merge
* [new ref] refs/pull/2682/head -> origin/pr/2682/head
* [new ref] refs/pull/2682/merge -> origin/pr/2682/merge
* [new ref] refs/pull/2683/head -> origin/pr/2683/head
* [new ref] refs/pull/2684/head -> origin/pr/2684/head
* [new ref] refs/pull/2685/head -> origin/pr/2685/head
* [new ref] refs/pull/2685/merge -> origin/pr/2685/merge
* [new ref] refs/pull/2686/head -> origin/pr/2686/head
* [new ref] refs/pull/2686/merge -> origin/pr/2686/merge
* [new ref] refs/pull/2687/head -> origin/pr/2687/head
* [new ref] refs/pull/2687/merge -> origin/pr/2687/merge
* [new ref] refs/pull/2688/head -> origin/pr/2688/head
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2728/merge -> origin/pr/2728/merge
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fdf2de9994268f5e1d704aa30a4504ac6ee624b8 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fdf2de9994268f5e1d704aa30a4504ac6ee624b8
> git rev-list 884935cb98f0e29bd965fda9182970423d111d7e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1481056550875902878.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7057979296962581930.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1649567276947638519.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4082715966327646198.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 20:26:33,447 b639e0e6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b639e0e6/pkb.log
2017-04-27 20:26:33,447 b639e0e6 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 20:26:33,448 b639e0e6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 20:26:33,625 b639e0e6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 20:26:33,723 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 20:26:33,726 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 20:26:33,727 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 20:26:33,735 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 20:26:33,738 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 20:26:33,753 b639e0e6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 20:26:33,753 b639e0e6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b639e0e6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #341
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/341/display/redirect?page=changes>
Changes:
[altay] [BEAM-1695] Improve Python-SDK's programming guide
------------------------------------------
[...truncated 309.18 KB...]
* [new ref] refs/pull/2673/head -> origin/pr/2673/head
* [new ref] refs/pull/2673/merge -> origin/pr/2673/merge
* [new ref] refs/pull/2674/head -> origin/pr/2674/head
* [new ref] refs/pull/2675/head -> origin/pr/2675/head
* [new ref] refs/pull/2676/head -> origin/pr/2676/head
* [new ref] refs/pull/2676/merge -> origin/pr/2676/merge
* [new ref] refs/pull/2677/head -> origin/pr/2677/head
* [new ref] refs/pull/2678/head -> origin/pr/2678/head
* [new ref] refs/pull/2678/merge -> origin/pr/2678/merge
* [new ref] refs/pull/2679/head -> origin/pr/2679/head
* [new ref] refs/pull/2679/merge -> origin/pr/2679/merge
* [new ref] refs/pull/2680/head -> origin/pr/2680/head
* [new ref] refs/pull/2680/merge -> origin/pr/2680/merge
* [new ref] refs/pull/2681/head -> origin/pr/2681/head
* [new ref] refs/pull/2681/merge -> origin/pr/2681/merge
* [new ref] refs/pull/2682/head -> origin/pr/2682/head
* [new ref] refs/pull/2682/merge -> origin/pr/2682/merge
* [new ref] refs/pull/2683/head -> origin/pr/2683/head
* [new ref] refs/pull/2684/head -> origin/pr/2684/head
* [new ref] refs/pull/2685/head -> origin/pr/2685/head
* [new ref] refs/pull/2685/merge -> origin/pr/2685/merge
* [new ref] refs/pull/2686/head -> origin/pr/2686/head
* [new ref] refs/pull/2686/merge -> origin/pr/2686/merge
* [new ref] refs/pull/2687/head -> origin/pr/2687/head
* [new ref] refs/pull/2687/merge -> origin/pr/2687/merge
* [new ref] refs/pull/2688/head -> origin/pr/2688/head
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2728/merge -> origin/pr/2728/merge
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 884935cb98f0e29bd965fda9182970423d111d7e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 884935cb98f0e29bd965fda9182970423d111d7e
> git rev-list 42e3a6f8588046f257e5c780dec12d16d0314a66 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6704943479662226469.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3812416565813157439.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8451535733436451284.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6961187350016169677.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 19:27:59,818 f0b1d683 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/f0b1d683/pkb.log
2017-04-27 19:27:59,819 f0b1d683 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 19:27:59,820 f0b1d683 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 19:28:00,404 f0b1d683 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 19:28:00,616 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 19:28:00,620 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 19:28:00,620 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 19:28:00,627 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 19:28:00,631 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 19:28:00,674 f0b1d683 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 19:28:00,675 f0b1d683 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/f0b1d683/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #340
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/340/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Move IOChannelUtils.constructName to FileBasedSink
[lcwik] [BEAM-1871] Move several options/auth classes around in gcp-core
[altay] Add extra message to deprecated annotation
------------------------------------------
[...truncated 113.83 KB...]
building 'numpy.core.umath' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/umath -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/core/src/umath/ufunc_type_resolution.c
x86_64-linux-gnu-gcc: numpy/core/src/umath/ufunc_object.c
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/scalarmath.c
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/loops.c
x86_64-linux-gnu-gcc: numpy/core/src/umath/umathmodule.c
x86_64-linux-gnu-gcc: numpy/core/src/umath/reduction.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/core/src/umath/umathmodule.o build/temp.linux-x86_64-2.7/numpy/core/src/umath/reduction.o build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/loops.o build/temp.linux-x86_64-2.7/numpy/core/src/umath/ufunc_object.o build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/scalarmath.o build/temp.linux-x86_64-2.7/numpy/core/src/umath/ufunc_type_resolution.o -Lbuild/temp.linux-x86_64-2.7 -lnpymath -lm -o build/lib.linux-x86_64-2.7/numpy/core/umath.so
building 'numpy.core.umath_tests' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/umath_tests.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/umath_tests.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/umath_tests.so
building 'numpy.core.test_rational' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/test_rational.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/test_rational.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/test_rational.so
building 'numpy.core.struct_ufunc_test' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/struct_ufunc_test.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/struct_ufunc_test.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/struct_ufunc_test.so
building 'numpy.core.multiarray_tests' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/core/src/private/mem_overlap.c
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/multiarray/multiarray_tests.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/multiarray/multiarray_tests.o build/temp.linux-x86_64-2.7/numpy/core/src/private/mem_overlap.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/multiarray_tests.so
building 'numpy.core.operand_flag_tests' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/operand_flag_tests.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/operand_flag_tests.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/operand_flag_tests.so
building 'numpy.fft.fftpack_lite' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/fft/fftpack.c
x86_64-linux-gnu-gcc: numpy/fft/fftpack_litemodule.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/fft/fftpack_litemodule.o build/temp.linux-x86_64-2.7/numpy/fft/fftpack.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/fft/fftpack_lite.so
building 'numpy.linalg.lapack_lite' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/python_xerbla.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlamch.c
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc4_’:
numpy/linalg/lapack_lite/dlamch.c:720:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc5_’:
numpy/linalg/lapack_lite/dlamch.c:834:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/blas_lite.c
numpy/linalg/lapack_lite/blas_lite.c: In function ‘cgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:352:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘dgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:6624:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘sgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:11190:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘zgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:15222:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: At top level:
numpy/linalg/lapack_lite/blas_lite.c:24:16: warning: ‘c__1’ defined but not used [-Wunused-variable]
static integer c__1 = 1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_litemodule.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlapack_lite.c
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘claed7_’:
numpy/linalg/lapack_lite/dlapack_lite.c:9857:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c:9857:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘dbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:27451:23: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static doublereal sminlo, tolmul;
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘sbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:64393:17: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static real sminlo, tolmul;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/f2c_lite.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/zlapack_lite.c
numpy/linalg/lapack_lite/zlapack_lite.c: In function ‘zlaed7_’:
numpy/linalg/lapack_lite/zlapack_lite.c:10000:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/zlapack_lite.c:10000:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/linalg/lapack_litemodule.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/python_xerbla.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/zlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/blas_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlamch.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/f2c_lite.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/linalg/lapack_lite.so
building 'numpy.linalg._umath_linalg' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/python_xerbla.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlamch.c
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc4_’:
numpy/linalg/lapack_lite/dlamch.c:720:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc5_’:
numpy/linalg/lapack_lite/dlamch.c:834:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/blas_lite.c
numpy/linalg/lapack_lite/blas_lite.c: In function ‘cgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:352:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘dgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:6624:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘sgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:11190:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘zgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:15222:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: At top level:
numpy/linalg/lapack_lite/blas_lite.c:24:16: warning: ‘c__1’ defined but not used [-Wunused-variable]
static integer c__1 = 1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlapack_lite.c
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘claed7_’:
numpy/linalg/lapack_lite/dlapack_lite.c:9857:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c:9857:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘dbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:27451:23: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static doublereal sminlo, tolmul;
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘sbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:64393:17: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static real sminlo, tolmul;
^
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/linalg/umath_linalg.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/f2c_lite.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/zlapack_lite.c
numpy/linalg/lapack_lite/zlapack_lite.c: In function ‘zlaed7_’:
numpy/linalg/lapack_lite/zlapack_lite.c:10000:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/zlapack_lite.c:10000:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/linalg/umath_linalg.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/python_xerbla.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/zlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/blas_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlamch.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/f2c_lite.o -Lbuild/temp.linux-x86_64-2.7 -lnpymath -o build/lib.linux-x86_64-2.7/numpy/linalg/_umath_linalg.so
building 'numpy.random.mtrand' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/random/mtrand/distributions.c
x86_64-linux-gnu-gcc: numpy/random/mtrand/mtrand.c
x86_64-linux-gnu-gcc: numpy/random/mtrand/initarray.c
x86_64-linux-gnu-gcc: numpy/random/mtrand/randomkit.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/random/mtrand/mtrand.o build/temp.linux-x86_64-2.7/numpy/random/mtrand/randomkit.o build/temp.linux-x86_64-2.7/numpy/random/mtrand/initarray.o build/temp.linux-x86_64-2.7/numpy/random/mtrand/distributions.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/random/mtrand.so
Creating build/scripts.linux-x86_64-2.7/f2py
adding 'build/scripts.linux-x86_64-2.7/f2py' to scripts
changing mode of build/scripts.linux-x86_64-2.7/f2py from 644 to 755
warning: no previously-included files matching '*.pyo' found anywhere in distribution
warning: no previously-included files matching '*.pyd' found anywhere in distribution
changing mode of /home/jenkins/.local/bin/f2py to 755
Running setup.py install for functools32
warning: no files found matching '*.txt'
no previously-included directories found matching 'build'
no previously-included directories found matching 'dist'
no previously-included directories found matching '.git*'
Successfully installed python-gflags colorlog blinker futures PyYAML pint numpy functools32 contextlib2
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5195933728526926087.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 18:56:02,639 848488b6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/848488b6/pkb.log
2017-04-27 18:56:02,639 848488b6 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 18:56:02,639 848488b6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 18:56:03,032 848488b6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 18:56:03,124 848488b6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 18:56:03,127 848488b6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 18:56:03,127 848488b6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 18:56:03,133 848488b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 18:56:03,135 848488b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 18:56:03,159 848488b6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 18:56:03,160 848488b6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/848488b6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #339
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/339/display/redirect?page=changes>
Changes:
[wtanaka] Rename openWindows => windowsThatAreOpen
[chamikara] Adding validatesrunner test for sources
[lcwik] Update pom.xml
[lcwik] [BEAM-2060] Allow to specify charset in XmlIO
[lcwik] [BEAM-2060] Use withCharset(Charset) for the user facing API
[dhalperi] Remove unnecessary semicolons
[tgroh] Use Structural Value when comparing Window(AndTrigger) Namespaces
[altay] Add ValueProvider tests to json_value_test.py
[bchambers] [BEAM-1148] Port PAssert away from aggregators
[sisk] TextIO & AvroIO no longer validate schemas against IOChannelFactory
[altay] Increase post commit timeout from 600 seconds to 900
[robertwb] Add instructions to regenerate Python proto wrappers.
[robertwb] Generate python proto wrappers for runner and fn API.
[robertwb] Add apache licence to generated files.
[robertwb] Adapt to PR #2505 changes to protos.
[lcwik] [BEAM-1871] Move ProtoCoder to new sdks/java/extensions/protobuf
[tgroh] Properly Declare Protobuf extension dependencies
[tgroh] Stop Extending AtomicCoder
[altay] Pin apitools to 0.5.8
[iemejia] Fix error with the artifactId on Flink runner after refactor
[iemejia] [BEAM-2075] Update flink runner to use flink version 1.2.1
[aljoscha.krettek] [BEAM-1772] Support merging WindowFn other than IntervalWindow on Flink
[aljoscha.krettek] [BEAM-1812] Add externalized checkpoint configuration to
[dhalperi] ByteKey: remove ByteString from public API, replace with ByteBuffer
[lcwik] [BEAM-1877] Use Iterables.isEmpty in GroupIntoBatches
[tgroh] Add `Filter#equal`
[tgroh] Add HadoopResourceId
[tgroh] Add Cloud Object Translators for Coders
[tgroh] Revert "Add HadoopResourceId"
[altay] Fix in dataflow metrics
[bchambers] Removing Aggregators from Examples
[bchambers] Removing Aggregators from runner-specific examples and tests
[bchambers] Removing Aggregators from PipelineResults and subclasses
[sourabhbajaj] [BEAM-2068] Update to latest version of apitools
[lcwik] [BEAM-1871] Move Bigquery/Pubsub options to
[tgroh] Make Most StandardCoders CustomCoders
[chamikara] [BEAM-1988] Add FileSystems Interface for accessing underlying FS
[altay] [BEAM-1989] Fix the syntax warning from import star
[altay] [BEAM-1749] Upgrade to pycodestyle
[dhalperi] Datastore: fix use of deprecated function
[wtanaka] Remove unused private fields
[chamikara] Updates DoFn invocation logic to be more extensible.
[lcwik] [BEAM-1871] Move ByteStringCoder to sdks/java/extensions/protobuf
[dhalperi] Update maven surefire and failsafe plugins to version 2.20
[lcwik] [BEAM-1871] Move functionality from AvroUtils to AvroSource hiding
[dhalperi] Add surefire-plugin.version property to archetype pom.xml
[tgroh] Remove AtomicCoder
[aviemzur] [BEAM-1958] Standard IO Metrics in Java SDK
[tgroh] Fix small typo in comment in CoderRegistry
[lcwik] [BEAM-1871] Remove deprecated methods from AvroCoder
[lcwik] [BEAM-2060] Add charset support in XmlSink
[lcwik] [BEAM-1871] Move RetryHttpRequestInitializer and remove deprecated
[dhalperi] LocalResourceId: make toString end in '/' for directories
[dhalperi] FileSystems: make tolerant of and more efficient for empty lists
[dhalperi] LocalFileSystem: create parent directories if needed
[lcwik] Add getElementCoders to UnionCoder
[dhalperi] Make it possible to test runners that don't support all metrics
[lcwik] Make WindowedValueCoder an Interface
[lcwik] [BEAM-1871] Drop usage of Jackson/CloudObject from CoGbkResultSchema
[kirpichov] [BEAM-1573] Use Kafka serializers instead of coders in KafkaIO
[bchambers] Remove aggregators from Dataflow runner
[klk] Replace OutputTimeFn UDF with TimestampCombiner enum
[lcwik] [BEAM-1871] Clean-up org.apache.beam.sdk.util, move BitSetCoder from
[lcwik] [BEAM-1871] Re-add BitSetCoder to sdk/util for Dataflow worker.
[altay] Do not depend on message id in DataflowRunner
[altay] [BEAM-1316] start bundle should not output any elements
[robertwb] Per-transform runner api dispatch.
[robertwb] Translate flatten to Runner API.
[robertwb] Translate WindowInto through the Runner API.
[robertwb] Factor out URN registration logic.
[kirpichov] update JavaDoc for Count.globally
[tgroh] Add Registrars for Coder Cloud Object Translators
[dhalperi] FileBasedSink: fix typos
[klk] Revert "Replace OutputTimeFn UDF with TimestampCombiner enum"
[tgroh] Revert "Make WindowedValueCoder an Interface"
[iemejia] Use parent pom version of hadoop, move common deps into the hadoop
[iemejia] Change to commons-lang dependency to commons-lang3 to be consistent with
[jbonofre] [BEAM-2091] Typo in build instructions in Apex Runner's README.md
[klk] Do not rely on metrics in streaming TestDataflowRunner
[thw] BEAM-1766 Remove Aggregators from Apex runner
[lcwik] XmlIO and XmlSource now take an optional validationEventHandler to throw
[tgroh] Mark Pipeline#getPipelineOptions Experimental
------------------------------------------
Started by timer
Started by timer
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam6 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1babed250404d4c1b5ce82034e1cda0bcfa71c26 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1babed250404d4c1b5ce82034e1cda0bcfa71c26
> git rev-list a67019739dc7f09a8336b9606c3726ad5d546f51 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8481344159617934558.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5395040492010499161.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1482093818285122542.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7652032562621552715.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 17:24:40,325 c2085155 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c2085155/pkb.log
2017-04-27 17:24:40,325 c2085155 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 17:24:40,326 c2085155 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 17:24:40,901 c2085155 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 17:24:41,043 c2085155 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 17:24:41,045 c2085155 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 17:24:41,046 c2085155 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 17:24:41,051 c2085155 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 17:24:41,053 c2085155 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 17:24:41,108 c2085155 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 17:24:41,108 c2085155 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c2085155/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #338
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/338/display/redirect?page=changes>
Changes:
[altay] [BEAM-1988] Migrate from utils.path to BFS
------------------------------------------
[...truncated 270.92 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 0f11265...780e3cd refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! b448bef...16e9c65 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! a9fedd2...10b9545 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! afe991b...c82ff73 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 0ae3202...ec1b6e0 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2517/merge: No such file or directory
! fa0c57f...f442410 refs/pull/2517/merge -> origin/pr/2517/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2518/merge: No such file or directory
! 10a8893...54a9356 refs/pull/2518/merge -> origin/pr/2518/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2519/merge: No such file or directory
! 98ea9f6...aad7043 refs/pull/2519/merge -> origin/pr/2519/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2520/merge: No such file or directory
! fc04459...07f8717 refs/pull/2520/merge -> origin/pr/2520/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2522/merge: No such file or directory
! c99fa26...c740b2d refs/pull/2522/merge -> origin/pr/2522/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2525/merge: No such file or directory
! 441d1b2...7e01908 refs/pull/2525/merge -> origin/pr/2525/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2527/merge: No such file or directory
! 216da5f...feee33b refs/pull/2527/merge -> origin/pr/2527/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2528/merge: No such file or directory
! 01b3137...6ee7dcc refs/pull/2528/merge -> origin/pr/2528/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2531/merge: No such file or directory
! 49d5bde...e435821 refs/pull/2531/merge -> origin/pr/2531/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2534/merge: No such file or directory
! 081af1f...ef9e0fc refs/pull/2534/merge -> origin/pr/2534/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2535/merge: No such file or directory
! 7d4bdcb...4ad387e refs/pull/2535/merge -> origin/pr/2535/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2538/head: No such file or directory
! e1f3b03...142e469 refs/pull/2538/head -> origin/pr/2538/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2538/merge: No such file or directory
! 8c865f5...f824c27 refs/pull/2538/merge -> origin/pr/2538/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2541/merge: No such file or directory
! a7fdea3...8b9aa21 refs/pull/2541/merge -> origin/pr/2541/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2544/merge: No such file or directory
! e52973a...4c36b29 refs/pull/2544/merge -> origin/pr/2544/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2555/merge: No such file or directory
! 219db6f...04900c3 refs/pull/2555/merge -> origin/pr/2555/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2573/merge: No such file or directory
! ff7c24f...c92f372 refs/pull/2573/merge -> origin/pr/2573/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2578/merge: No such file or directory
! 9b3d521...2a90ded refs/pull/2578/merge -> origin/pr/2578/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2581/merge: No such file or directory
! b905438...b6f4753 refs/pull/2581/merge -> origin/pr/2581/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2591/merge: No such file or directory
! f0b2095...81d27bb refs/pull/2591/merge -> origin/pr/2591/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2593/merge: No such file or directory
! 88036dc...6950873 refs/pull/2593/merge -> origin/pr/2593/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2595/merge: No such file or directory
! a1da297...a86fe73 refs/pull/2595/merge -> origin/pr/2595/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2597/merge: No such file or directory
! f6d46f5...bad5fb6 refs/pull/2597/merge -> origin/pr/2597/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2603/merge: No such file or directory
! 956876b...811d0eb refs/pull/2603/merge -> origin/pr/2603/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2609/merge: No such file or directory
! c596646...e8440c5 refs/pull/2609/merge -> origin/pr/2609/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2611/merge: No such file or directory
! cb24c79...a2fc9c6 refs/pull/2611/merge -> origin/pr/2611/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2612/merge: No such file or directory
! 071e347...fde1693 refs/pull/2612/merge -> origin/pr/2612/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2615/merge: No such file or directory
! 66b12ee...90a071d refs/pull/2615/merge -> origin/pr/2615/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2617/merge: No such file or directory
! fcaa4c1...8aeff7f refs/pull/2617/merge -> origin/pr/2617/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2620/merge: No such file or directory
! 94305ad...325d694 refs/pull/2620/merge -> origin/pr/2620/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2622/merge: No such file or directory
! 88414bb...bd3c5d0 refs/pull/2622/merge -> origin/pr/2622/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2625/merge: No such file or directory
! f8009ae...d4b3686 refs/pull/2625/merge -> origin/pr/2625/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2626/merge: No such file or directory
! f253a9a...a6320e1 refs/pull/2626/merge -> origin/pr/2626/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2627/merge: No such file or directory
! c0125ba...9b3449b refs/pull/2627/merge -> origin/pr/2627/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2630/merge: No such file or directory
! 7cc8e95...ca206d9 refs/pull/2630/merge -> origin/pr/2630/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2631/merge: No such file or directory
! 0373f59...5ece9c8 refs/pull/2631/merge -> origin/pr/2631/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2632/merge: No such file or directory
! 8fb02b8...6f95956 refs/pull/2632/merge -> origin/pr/2632/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2633/merge: No such file or directory
! e0d3a93...bfb2227 refs/pull/2633/merge -> origin/pr/2633/merge (unable to update local ref)
* [new ref] refs/pull/2634/head -> origin/pr/2634/head
* [new ref] refs/pull/2634/merge -> origin/pr/2634/merge
* [new ref] refs/pull/2635/head -> origin/pr/2635/head
* [new ref] refs/pull/2636/head -> origin/pr/2636/head
* [new ref] refs/pull/2636/merge -> origin/pr/2636/merge
* [new ref] refs/pull/2637/head -> origin/pr/2637/head
* [new ref] refs/pull/2637/merge -> origin/pr/2637/merge
* [new ref] refs/pull/2638/head -> origin/pr/2638/head
* [new ref] refs/pull/2638/merge -> origin/pr/2638/merge
* [new ref] refs/pull/2639/head -> origin/pr/2639/head
* [new ref] refs/pull/2639/merge -> origin/pr/2639/merge
* [new ref] refs/pull/2640/head -> origin/pr/2640/head
* [new ref] refs/pull/2640/merge -> origin/pr/2640/merge
* [new ref] refs/pull/2641/head -> origin/pr/2641/head
* [new ref] refs/pull/2641/merge -> origin/pr/2641/merge
* [new ref] refs/pull/2642/head -> origin/pr/2642/head
* [new ref] refs/pull/2642/merge -> origin/pr/2642/merge
* [new ref] refs/pull/2643/head -> origin/pr/2643/head
* [new ref] refs/pull/2643/merge -> origin/pr/2643/merge
* [new ref] refs/pull/2644/head -> origin/pr/2644/head
* [new ref] refs/pull/2644/merge -> origin/pr/2644/merge
* [new ref] refs/pull/2645/head -> origin/pr/2645/head
* [new ref] refs/pull/2645/merge -> origin/pr/2645/merge
* [new ref] refs/pull/2646/head -> origin/pr/2646/head
* [new ref] refs/pull/2646/merge -> origin/pr/2646/merge
* [new ref] refs/pull/2647/head -> origin/pr/2647/head
* [new ref] refs/pull/2647/merge -> origin/pr/2647/merge
* [new ref] refs/pull/2648/head -> origin/pr/2648/head
* [new ref] refs/pull/2648/merge -> origin/pr/2648/merge
* [new ref] refs/pull/2649/head -> origin/pr/2649/head
* [new ref] refs/pull/2649/merge -> origin/pr/2649/merge
* [new ref] refs/pull/2650/head -> origin/pr/2650/head
* [new ref] refs/pull/2650/merge -> origin/pr/2650/merge
* [new ref] refs/pull/2651/head -> origin/pr/2651/head
* [new ref] refs/pull/2651/merge -> origin/pr/2651/merge
* [new ref] refs/pull/2652/head -> origin/pr/2652/head
* [new ref] refs/pull/2652/merge -> origin/pr/2652/merge
* [new ref] refs/pull/2653/head -> origin/pr/2653/head
* [new ref] refs/pull/2653/merge -> origin/pr/2653/merge
* [new ref] refs/pull/2654/head -> origin/pr/2654/head
* [new ref] refs/pull/2654/merge -> origin/pr/2654/merge
* [new ref] refs/pull/2655/head -> origin/pr/2655/head
* [new ref] refs/pull/2655/merge -> origin/pr/2655/merge
* [new ref] refs/pull/2656/head -> origin/pr/2656/head
* [new ref] refs/pull/2656/merge -> origin/pr/2656/merge
* [new ref] refs/pull/2657/head -> origin/pr/2657/head
* [new ref] refs/pull/2657/merge -> origin/pr/2657/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor584.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a67019739dc7f09a8336b9606c3726ad5d546f51 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a67019739dc7f09a8336b9606c3726ad5d546f51
> git rev-list 1dce98f0745e9c1cc4d83a7532895f2f28ec86bf # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3820256674966605868.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1772409161506125821.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7031598677226722041.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5096140202131393241.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-24 01:19:55,466 3daa2bb9 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3daa2bb9/pkb.log
2017-04-24 01:19:55,466 3daa2bb9 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-24 01:19:55,467 3daa2bb9 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-24 01:19:55,799 3daa2bb9 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-24 01:19:55,889 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-24 01:19:55,892 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-24 01:19:55,892 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-24 01:19:55,897 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-24 01:19:55,899 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-24 01:19:55,924 3daa2bb9 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-24 01:19:55,925 3daa2bb9 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3daa2bb9/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #337
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/337/display/redirect?page=changes>
Changes:
[lcwik] Validates that input and output GCS paths specify a bucket
[kirpichov] Makes cachedSplitResult transient in BigQuerySourceBase
[lcwik] Update Dataflow Worker Version
[tgroh] Coder.structuralValue(T) should never throw
[chamikara] [BEAM-1988] Add join operation to the filesystem
[chamikara] Change dataflow Job log from info to debug
[tgroh] Remove DeterministicStandardCoder
[lcwik] [BEAM-1786] Post Dataflow worker CoderRegistry clean-up
[lcwik] [BEAM-1871] Remove unnecessary runtime dependencies for Google Cloud
[lcwik] [BEAM-1871] Move Xml IO and related classes to new sdks/java/io/xml
[kirpichov] Introduces GenerateSequence transform
[kirpichov] Replaces all usages of CountingInput with GenerateSequence
[kirpichov] Deletes CountingInput
[kirpichov] Replaces fromTo() with from().to()
[tgroh] Make SimplePCollectionView Visible
[jbonofre] [BEAM-2044] Upgrade HBaseIO to use HBase client version 1.3.1
[kirpichov] [BEAM-1428] KinesisIO should comply with PTransform style guide
[jbonofre] [BEAM-2044] Downgrade HBaseIO to use the stable HBase client version
------------------------------------------
[...truncated 301.79 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2565/merge: No such file or directory
! 8d8deaa...0d15126 refs/pull/2565/merge -> origin/pr/2565/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2577/merge: No such file or directory
! c754797...318505c refs/pull/2577/merge -> origin/pr/2577/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2578/merge: No such file or directory
! 9626f20...9b3d521 refs/pull/2578/merge -> origin/pr/2578/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2579/merge: No such file or directory
! 612129b...23a6992 refs/pull/2579/merge -> origin/pr/2579/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2583/merge: No such file or directory
! 10f5731...0036268 refs/pull/2583/merge -> origin/pr/2583/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2585/merge: No such file or directory
! 9d76f1b...2e46ca2 refs/pull/2585/merge -> origin/pr/2585/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2586/merge: No such file or directory
! 96ed22a...01309ce refs/pull/2586/merge -> origin/pr/2586/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2587/merge: No such file or directory
! 5007331...afc4e4d refs/pull/2587/merge -> origin/pr/2587/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2591/head: No such file or directory
! 09693e1...dddf8ea refs/pull/2591/head -> origin/pr/2591/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2591/merge: No such file or directory
! 8e64258...f0b2095 refs/pull/2591/merge -> origin/pr/2591/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2592/merge: No such file or directory
! 4a576ac...745acd7 refs/pull/2592/merge -> origin/pr/2592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2593/merge: No such file or directory
! a155fdd...88036dc refs/pull/2593/merge -> origin/pr/2593/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2594/merge: No such file or directory
! f84f6e6...088b3f8 refs/pull/2594/merge -> origin/pr/2594/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2595/merge: No such file or directory
! 1f9dbb3...a1da297 refs/pull/2595/merge -> origin/pr/2595/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2596/merge: No such file or directory
! 1632f84...4711963 refs/pull/2596/merge -> origin/pr/2596/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2597/merge: No such file or directory
! 760bf36...f6d46f5 refs/pull/2597/merge -> origin/pr/2597/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2601/head: No such file or directory
! a79e43e..10545e5 refs/pull/2601/head -> origin/pr/2601/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2601/merge: No such file or directory
! be457d8...e614410 refs/pull/2601/merge -> origin/pr/2601/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2602/merge: No such file or directory
! c392c0a...9b63013 refs/pull/2602/merge -> origin/pr/2602/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2603/merge: No such file or directory
! c93f436...956876b refs/pull/2603/merge -> origin/pr/2603/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2604/merge: No such file or directory
! b6086fd...db1763c refs/pull/2604/merge -> origin/pr/2604/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2606/merge: No such file or directory
! 20d5c0c...d5bb314 refs/pull/2606/merge -> origin/pr/2606/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2607/merge: No such file or directory
! 9c1b65b...77bc015 refs/pull/2607/merge -> origin/pr/2607/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2608/merge: No such file or directory
! 4aac841...0a79e06 refs/pull/2608/merge -> origin/pr/2608/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2609/merge: No such file or directory
! 06c64e4...c596646 refs/pull/2609/merge -> origin/pr/2609/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2611/merge: No such file or directory
! d8747f5...cb24c79 refs/pull/2611/merge -> origin/pr/2611/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2612/head: No such file or directory
! 1fbab77...43c6c3a refs/pull/2612/head -> origin/pr/2612/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2612/merge: No such file or directory
! 063960f...071e347 refs/pull/2612/merge -> origin/pr/2612/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2615/merge: No such file or directory
! 905ac4d...66b12ee refs/pull/2615/merge -> origin/pr/2615/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2617/merge: No such file or directory
! 43412f1...fcaa4c1 refs/pull/2617/merge -> origin/pr/2617/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2620/merge: No such file or directory
! 8e44ad3...94305ad refs/pull/2620/merge -> origin/pr/2620/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2622/merge: No such file or directory
! bad5814...88414bb refs/pull/2622/merge -> origin/pr/2622/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2625/merge: No such file or directory
! 181104c...f8009ae refs/pull/2625/merge -> origin/pr/2625/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2626/head: No such file or directory
! 7365423...6d4aeab refs/pull/2626/head -> origin/pr/2626/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2626/merge: No such file or directory
! a20a922...f253a9a refs/pull/2626/merge -> origin/pr/2626/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2627/merge: No such file or directory
! 750ee4a...c0125ba refs/pull/2627/merge -> origin/pr/2627/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2629/merge: No such file or directory
! 96be125...94801ef refs/pull/2629/merge -> origin/pr/2629/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2630/merge: No such file or directory
! f558484...7cc8e95 refs/pull/2630/merge -> origin/pr/2630/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2631/merge: No such file or directory
! 54713d3...0373f59 refs/pull/2631/merge -> origin/pr/2631/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2632/head: No such file or directory
! f4f94db..c040104 refs/pull/2632/head -> origin/pr/2632/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2632/merge: No such file or directory
! 8bd47d1...8fb02b8 refs/pull/2632/merge -> origin/pr/2632/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2633/merge: No such file or directory
! c0af0a3...e0d3a93 refs/pull/2633/merge -> origin/pr/2633/merge (unable to update local ref)
* [new ref] refs/pull/2634/head -> origin/pr/2634/head
* [new ref] refs/pull/2634/merge -> origin/pr/2634/merge
* [new ref] refs/pull/2635/head -> origin/pr/2635/head
* [new ref] refs/pull/2636/head -> origin/pr/2636/head
* [new ref] refs/pull/2636/merge -> origin/pr/2636/merge
* [new ref] refs/pull/2637/head -> origin/pr/2637/head
* [new ref] refs/pull/2637/merge -> origin/pr/2637/merge
* [new ref] refs/pull/2638/head -> origin/pr/2638/head
* [new ref] refs/pull/2638/merge -> origin/pr/2638/merge
* [new ref] refs/pull/2639/head -> origin/pr/2639/head
* [new ref] refs/pull/2639/merge -> origin/pr/2639/merge
* [new ref] refs/pull/2640/head -> origin/pr/2640/head
* [new ref] refs/pull/2640/merge -> origin/pr/2640/merge
* [new ref] refs/pull/2641/head -> origin/pr/2641/head
* [new ref] refs/pull/2641/merge -> origin/pr/2641/merge
* [new ref] refs/pull/2642/head -> origin/pr/2642/head
* [new ref] refs/pull/2642/merge -> origin/pr/2642/merge
* [new ref] refs/pull/2643/head -> origin/pr/2643/head
* [new ref] refs/pull/2643/merge -> origin/pr/2643/merge
* [new ref] refs/pull/2644/head -> origin/pr/2644/head
* [new ref] refs/pull/2644/merge -> origin/pr/2644/merge
* [new ref] refs/pull/2645/head -> origin/pr/2645/head
* [new ref] refs/pull/2645/merge -> origin/pr/2645/merge
* [new ref] refs/pull/2646/head -> origin/pr/2646/head
* [new ref] refs/pull/2646/merge -> origin/pr/2646/merge
* [new ref] refs/pull/2647/head -> origin/pr/2647/head
* [new ref] refs/pull/2647/merge -> origin/pr/2647/merge
* [new ref] refs/pull/2648/head -> origin/pr/2648/head
* [new ref] refs/pull/2648/merge -> origin/pr/2648/merge
* [new ref] refs/pull/2649/head -> origin/pr/2649/head
* [new ref] refs/pull/2649/merge -> origin/pr/2649/merge
* [new ref] refs/pull/2650/head -> origin/pr/2650/head
* [new ref] refs/pull/2650/merge -> origin/pr/2650/merge
* [new ref] refs/pull/2651/head -> origin/pr/2651/head
* [new ref] refs/pull/2651/merge -> origin/pr/2651/merge
* [new ref] refs/pull/2652/head -> origin/pr/2652/head
* [new ref] refs/pull/2652/merge -> origin/pr/2652/merge
* [new ref] refs/pull/2653/head -> origin/pr/2653/head
* [new ref] refs/pull/2653/merge -> origin/pr/2653/merge
* [new ref] refs/pull/2654/head -> origin/pr/2654/head
* [new ref] refs/pull/2654/merge -> origin/pr/2654/merge
* [new ref] refs/pull/2655/head -> origin/pr/2655/head
* [new ref] refs/pull/2655/merge -> origin/pr/2655/merge
* [new ref] refs/pull/2656/head -> origin/pr/2656/head
* [new ref] refs/pull/2656/merge -> origin/pr/2656/merge
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! 33b68a2...f9612e3 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 88fbba8...0d9a8ae refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1dce98f0745e9c1cc4d83a7532895f2f28ec86bf (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1dce98f0745e9c1cc4d83a7532895f2f28ec86bf
> git rev-list f3806f64f2f80d9ff04f161bb60bbfe6c663dd05 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5115482460724809902.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3477231007021095089.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson64432856848543630.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3378241908788949308.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-23 13:17:35,444 d31400d9 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d31400d9/pkb.log
2017-04-23 13:17:35,444 d31400d9 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-23 13:17:35,445 d31400d9 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-23 13:17:35,977 d31400d9 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-23 13:17:36,096 d31400d9 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-23 13:17:36,098 d31400d9 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-23 13:17:36,099 d31400d9 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-23 13:17:36,105 d31400d9 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-23 13:17:36,108 d31400d9 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-23 13:17:36,118 d31400d9 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-23 13:17:36,119 d31400d9 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d31400d9/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #336
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/336/display/redirect?page=changes>
Changes:
[klk] Inline and remove POutputValueBase
[tgroh] Improve GlobalWindow, IntervalWindow Coders
------------------------------------------
[...truncated 232.45 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f3806f64f2f80d9ff04f161bb60bbfe6c663dd05 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f3806f64f2f80d9ff04f161bb60bbfe6c663dd05
> git rev-list 8160924e12a4723df34209a04c907d4f95466ecf # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8714472946511256926.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1848932547714709924.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2766001969086583293.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3630428433477182461.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 18:01:49,081 570bf0bd MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/570bf0bd/pkb.log
2017-04-21 18:01:49,081 570bf0bd MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 18:01:49,082 570bf0bd MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 18:01:49,420 570bf0bd MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 18:01:49,498 570bf0bd MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 18:01:49,500 570bf0bd MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 18:01:49,501 570bf0bd MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 18:01:49,504 570bf0bd MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 18:01:49,506 570bf0bd MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 18:01:49,536 570bf0bd MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 18:01:49,537 570bf0bd MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/570bf0bd/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #335
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/335/display/redirect?page=changes>
Changes:
[aljoscha.krettek] [BEAM-773] Implement Metrics support for Flink runner
[aljoscha.krettek] Add IO metrics to Flink runner
[aljoscha.krettek] Ensure all Read outputs are consumed in Flink runner
------------------------------------------
[...truncated 264.67 KB...]
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
* [new ref] refs/pull/2613/head -> origin/pr/2613/head
* [new ref] refs/pull/2614/head -> origin/pr/2614/head
* [new ref] refs/pull/2615/head -> origin/pr/2615/head
* [new ref] refs/pull/2615/merge -> origin/pr/2615/merge
* [new ref] refs/pull/2616/head -> origin/pr/2616/head
* [new ref] refs/pull/2616/merge -> origin/pr/2616/merge
* [new ref] refs/pull/2617/head -> origin/pr/2617/head
* [new ref] refs/pull/2617/merge -> origin/pr/2617/merge
* [new ref] refs/pull/2618/head -> origin/pr/2618/head
* [new ref] refs/pull/2619/head -> origin/pr/2619/head
* [new ref] refs/pull/2619/merge -> origin/pr/2619/merge
* [new ref] refs/pull/2620/head -> origin/pr/2620/head
* [new ref] refs/pull/2620/merge -> origin/pr/2620/merge
* [new ref] refs/pull/2621/head -> origin/pr/2621/head
* [new ref] refs/pull/2621/merge -> origin/pr/2621/merge
* [new ref] refs/pull/2622/head -> origin/pr/2622/head
* [new ref] refs/pull/2622/merge -> origin/pr/2622/merge
* [new ref] refs/pull/2623/head -> origin/pr/2623/head
* [new ref] refs/pull/2623/merge -> origin/pr/2623/merge
* [new ref] refs/pull/2624/head -> origin/pr/2624/head
* [new ref] refs/pull/2625/head -> origin/pr/2625/head
* [new ref] refs/pull/2625/merge -> origin/pr/2625/merge
* [new ref] refs/pull/2626/head -> origin/pr/2626/head
* [new ref] refs/pull/2626/merge -> origin/pr/2626/merge
* [new ref] refs/pull/2627/head -> origin/pr/2627/head
* [new ref] refs/pull/2627/merge -> origin/pr/2627/merge
* [new ref] refs/pull/2628/head -> origin/pr/2628/head
* [new ref] refs/pull/2628/merge -> origin/pr/2628/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 2ecab23...856bade refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8160924e12a4723df34209a04c907d4f95466ecf (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8160924e12a4723df34209a04c907d4f95466ecf
> git rev-list b3827955e3898b5f39d5b45db40c884b92cd3cef # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1736839190964272974.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4261684650816203298.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6450516308736435345.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4295639915615809346.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 12:02:40,509 fde62082 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/fde62082/pkb.log
2017-04-21 12:02:40,509 fde62082 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 12:02:40,510 fde62082 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 12:02:40,689 fde62082 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 12:02:40,784 fde62082 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 12:02:40,786 fde62082 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 12:02:40,786 fde62082 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 12:02:40,791 fde62082 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 12:02:40,793 fde62082 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 12:02:40,820 fde62082 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 12:02:40,821 fde62082 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/fde62082/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #334
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/334/display/redirect?page=changes>
Changes:
[klk] Make crashing errors in Structs unchecked exceptions
[klk] Derive Dataflow output names from steps, not PCollection names
[dhalperi] [BEAM-2012] Remove BoundedSource.splitIntoBundles for real
[dhalperi] Upgrade autovalue
[altay] Fix GCP import check in bigquery.py
------------------------------------------
[...truncated 272.29 KB...]
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
* [new ref] refs/pull/2613/head -> origin/pr/2613/head
* [new ref] refs/pull/2614/head -> origin/pr/2614/head
* [new ref] refs/pull/2615/head -> origin/pr/2615/head
* [new ref] refs/pull/2615/merge -> origin/pr/2615/merge
* [new ref] refs/pull/2616/head -> origin/pr/2616/head
* [new ref] refs/pull/2616/merge -> origin/pr/2616/merge
* [new ref] refs/pull/2617/head -> origin/pr/2617/head
* [new ref] refs/pull/2617/merge -> origin/pr/2617/merge
* [new ref] refs/pull/2618/head -> origin/pr/2618/head
* [new ref] refs/pull/2619/head -> origin/pr/2619/head
* [new ref] refs/pull/2619/merge -> origin/pr/2619/merge
* [new ref] refs/pull/2620/head -> origin/pr/2620/head
* [new ref] refs/pull/2620/merge -> origin/pr/2620/merge
* [new ref] refs/pull/2621/head -> origin/pr/2621/head
* [new ref] refs/pull/2621/merge -> origin/pr/2621/merge
* [new ref] refs/pull/2622/head -> origin/pr/2622/head
* [new ref] refs/pull/2622/merge -> origin/pr/2622/merge
* [new ref] refs/pull/2623/head -> origin/pr/2623/head
* [new ref] refs/pull/2623/merge -> origin/pr/2623/merge
* [new ref] refs/pull/2624/head -> origin/pr/2624/head
* [new ref] refs/pull/2625/head -> origin/pr/2625/head
* [new ref] refs/pull/2625/merge -> origin/pr/2625/merge
* [new ref] refs/pull/2626/head -> origin/pr/2626/head
* [new ref] refs/pull/2626/merge -> origin/pr/2626/merge
* [new ref] refs/pull/2627/head -> origin/pr/2627/head
* [new ref] refs/pull/2627/merge -> origin/pr/2627/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! c595f6e...2ecab23 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b3827955e3898b5f39d5b45db40c884b92cd3cef (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b3827955e3898b5f39d5b45db40c884b92cd3cef
> git rev-list 524165ac95d01e6c4e4b97911e5e4cce78677a93 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4192513743201487707.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2598521639352903674.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8704712167288035670.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6204150598789171428.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 06:02:09,245 bbfe7ede MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bbfe7ede/pkb.log
2017-04-21 06:02:09,245 bbfe7ede MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 06:02:09,245 bbfe7ede MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 06:02:09,595 bbfe7ede MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 06:02:09,674 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 06:02:09,676 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 06:02:09,676 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 06:02:09,680 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 06:02:09,682 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 06:02:09,712 bbfe7ede MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 06:02:09,712 bbfe7ede MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bbfe7ede/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #333
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/333/display/redirect?page=changes>
Changes:
[dhalperi] Add javadoc to the Metric interfaces
[dhalperi] Fix javadoc typo
[klk] Remove Sink in favor of FileBasedSink
[lcwik] [BEAM-1786, BEAM-1871] Add the ability to register coder factories for
[lcwik] [BEAM-1871] Move over GcsPath to gcp-core
[dhalperi] [BEAM-59] FileBasedSource: convert to FileSystem
[kirpichov] [BEAM-1992] Move Count.PerElement javadoc to a public place
[kirpichov] Fix erroneous use of .expand() in KafkaIO
[altay] Remove _unused_options_id
------------------------------------------
[...truncated 268.19 KB...]
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
* [new ref] refs/pull/2613/head -> origin/pr/2613/head
* [new ref] refs/pull/2614/head -> origin/pr/2614/head
* [new ref] refs/pull/2615/head -> origin/pr/2615/head
* [new ref] refs/pull/2615/merge -> origin/pr/2615/merge
* [new ref] refs/pull/2616/head -> origin/pr/2616/head
* [new ref] refs/pull/2616/merge -> origin/pr/2616/merge
* [new ref] refs/pull/2617/head -> origin/pr/2617/head
* [new ref] refs/pull/2617/merge -> origin/pr/2617/merge
* [new ref] refs/pull/2618/head -> origin/pr/2618/head
* [new ref] refs/pull/2618/merge -> origin/pr/2618/merge
* [new ref] refs/pull/2619/head -> origin/pr/2619/head
* [new ref] refs/pull/2619/merge -> origin/pr/2619/merge
* [new ref] refs/pull/2620/head -> origin/pr/2620/head
* [new ref] refs/pull/2620/merge -> origin/pr/2620/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 7088ca3...c595f6e refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 524165ac95d01e6c4e4b97911e5e4cce78677a93 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 524165ac95d01e6c4e4b97911e5e4cce78677a93
> git rev-list bf16b4a80562cb9db1cd4adba354dd393ed7afd0 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1838359322014054068.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1019098651526907023.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4757535067975429973.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8186375252874857784.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 00:02:23,450 17af334b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/17af334b/pkb.log
2017-04-21 00:02:23,450 17af334b MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 00:02:23,451 17af334b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 00:02:23,848 17af334b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 00:02:23,938 17af334b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 00:02:23,941 17af334b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 00:02:23,941 17af334b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 00:02:23,947 17af334b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 00:02:23,949 17af334b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 00:02:23,974 17af334b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 00:02:23,975 17af334b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/17af334b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #332
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/332/display/redirect?page=changes>
Changes:
[tgroh] [BEAM-1948] Defend against absent Aggregators
[robertwb] [BEAM-662] Fix for allowing floating point periods in windows
[robertwb] Make stage names consistent.
[robertwb] Require deterministic window coders.
[robertwb] Enable IntervalWindowCoder test check.
[robertwb] Remove obsolete and unused Runner.clear
[robertwb] Rename AfterFirst to AfterAny for consistency with Java.
[robertwb] Remove bigshuffle from python examples
[robertwb] Remove vestigial Read and Write from core.py
[aljoscha.krettek] [BEAM-1886] Remove TextIO override in Flink runner
[aljoscha.krettek] Exclude UsesSplittableParDoWithWindowedSideInputs in Flink Stream Runner
[altay] Fix KafkaIO javadoc typo
------------------------------------------
[...truncated 261.02 KB...]
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! b9bfa5a...7088ca3 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision bf16b4a80562cb9db1cd4adba354dd393ed7afd0 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f bf16b4a80562cb9db1cd4adba354dd393ed7afd0
> git rev-list 104f9823563c4a2cd2ef9495e9a16b3a219dd49b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4510350363730592827.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8634217960513722945.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4714285922725186566.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1069675392217594109.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 18:02:03,583 9cf86a74 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/9cf86a74/pkb.log
2017-04-20 18:02:03,584 9cf86a74 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 18:02:03,584 9cf86a74 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 18:02:04,221 9cf86a74 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 18:02:04,356 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 18:02:04,358 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 18:02:04,359 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 18:02:04,363 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 18:02:04,365 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 18:02:04,378 9cf86a74 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 18:02:04,379 9cf86a74 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/9cf86a74/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #331
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/331/display/redirect>
------------------------------------------
[...truncated 259.73 KB...]
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 104f9823563c4a2cd2ef9495e9a16b3a219dd49b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 104f9823563c4a2cd2ef9495e9a16b3a219dd49b
> git rev-list 104f9823563c4a2cd2ef9495e9a16b3a219dd49b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1686600943140788379.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5687234350595086105.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8890289747034149854.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5629853312363568363.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 12:01:56,850 3ffb136c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3ffb136c/pkb.log
2017-04-20 12:01:56,850 3ffb136c MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 12:01:56,851 3ffb136c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 12:01:57,047 3ffb136c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 12:01:57,126 3ffb136c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 12:01:57,128 3ffb136c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 12:01:57,129 3ffb136c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 12:01:57,134 3ffb136c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 12:01:57,136 3ffb136c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 12:01:57,165 3ffb136c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 12:01:57,165 3ffb136c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3ffb136c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #330
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/330/display/redirect?page=changes>
Changes:
[chamikara] add temp dataset location for non-query BigQuerySource
------------------------------------------
[...truncated 259.98 KB...]
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 0d420d3...b9bfa5a refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/959/merge: No such file or directory
! 39c9afa...25d5f19 refs/pull/959/merge -> origin/pr/959/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/984/merge: No such file or directory
! 54fa2a8...da83b57 refs/pull/984/merge -> origin/pr/984/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 104f9823563c4a2cd2ef9495e9a16b3a219dd49b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 104f9823563c4a2cd2ef9495e9a16b3a219dd49b
> git rev-list 3ef614c72d24f44a8cf463040a2bcf17b9445bc8 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8286626980164617294.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson498259845201682450.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1786429201611599997.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2156720948161282351.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 06:02:22,876 e08fd0e7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/e08fd0e7/pkb.log
2017-04-20 06:02:22,876 e08fd0e7 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 06:02:22,876 e08fd0e7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 06:02:23,250 e08fd0e7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 06:02:23,343 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 06:02:23,345 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 06:02:23,346 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 06:02:23,352 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 06:02:23,354 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 06:02:23,377 e08fd0e7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 06:02:23,378 e08fd0e7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/e08fd0e7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #329
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/329/display/redirect?page=changes>
Changes:
[kirpichov] Cache result of BigQuerySourceBase.split
[dhalperi] [BEAM-2015] Remove shared profile in runners/pom.xml and fix Dataflow
[lcwik] [BEAM-2014] Upgrade to Google Auth 0.6.1
[lcwik] [BEAM-2013] Upgrade to Jackson 2.8.8
[dhalperi] [BEAM-2017] Fix NPE in DataflowRunner when there are no metrics
[lcwik] [BEAM-1871] Remove another depedendency by moving TestCredential
[lcwik] Modify types for input PCollections of Flatten transform to that of the
[altay] added module option, use more common zero test, show module name in log
------------------------------------------
[...truncated 266.21 KB...]
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! e816697...0d420d3 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/809/merge: No such file or directory
! ac26af4...50ab53b refs/pull/809/merge -> origin/pr/809/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/810/merge: No such file or directory
! edfdeb5...7cab9bf refs/pull/810/merge -> origin/pr/810/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/819/merge: No such file or directory
! 94703ec...f95321a refs/pull/819/merge -> origin/pr/819/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/838/merge: No such file or directory
! 53a8fe0...3eb5563 refs/pull/838/merge -> origin/pr/838/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/871/merge: No such file or directory
! 61f4dd5...dcc5b0b refs/pull/871/merge -> origin/pr/871/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/886/merge: No such file or directory
! 01f16da...9fe583c refs/pull/886/merge -> origin/pr/886/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! c0c0a26...c340815 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/902/merge: No such file or directory
! 38d7315...824f162 refs/pull/902/merge -> origin/pr/902/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/914/merge: No such file or directory
! 3c4444a...b93dd41 refs/pull/914/merge -> origin/pr/914/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/917/merge: No such file or directory
! 7db5e68...b264c75 refs/pull/917/merge -> origin/pr/917/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3ef614c72d24f44a8cf463040a2bcf17b9445bc8 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3ef614c72d24f44a8cf463040a2bcf17b9445bc8
> git rev-list 29e054a8d7ffe6a061dbbe9a1885185b02f4e8ec # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2663058786604102121.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8290558974798900018.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4943685089095665165.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7646488805423744271.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 00:02:03,418 bf07c8ef MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bf07c8ef/pkb.log
2017-04-20 00:02:03,418 bf07c8ef MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 00:02:03,418 bf07c8ef MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 00:02:03,849 bf07c8ef MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 00:02:03,935 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 00:02:03,938 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 00:02:03,938 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 00:02:03,943 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 00:02:03,945 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 00:02:03,971 bf07c8ef MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 00:02:03,972 bf07c8ef MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bf07c8ef/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #328
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/328/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-1994] Remove Flink examples package
[chamikara] [BEAM-1441] Remove deprecated ChannelFactory
[tgroh] Ensure all Read outputs are consumed in Dataflow
------------------------------------------
[...truncated 239.71 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 29e054a8d7ffe6a061dbbe9a1885185b02f4e8ec (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 29e054a8d7ffe6a061dbbe9a1885185b02f4e8ec
> git rev-list 8a00f225454bcc742e5b38a499237bd5de455fb7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8365579214532950003.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1454548667904036598.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1369842140295342366.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5369403042547739192.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 18:03:52,596 80cdb2f8 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/80cdb2f8/pkb.log
2017-04-19 18:03:52,597 80cdb2f8 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 18:03:52,598 80cdb2f8 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 18:03:53,263 80cdb2f8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 18:03:53,439 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 18:03:53,441 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 18:03:53,442 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 18:03:53,449 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 18:03:53,452 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 18:03:53,462 80cdb2f8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 18:03:53,463 80cdb2f8 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/80cdb2f8/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #327
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/327/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-1914]Â XmlIO now complies with PTransform style guide
[iemejia] Pin default commons-compress version to beam-parent pom
------------------------------------------
[...truncated 259.49 KB...]
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 04ca87a...b839137 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2576/merge -> origin/pr/2576/merge
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2584/merge -> origin/pr/2584/merge
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 3af926b...e816697 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/610/merge: No such file or directory
! 48d03d0...ff3ad90 refs/pull/610/merge -> origin/pr/610/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/618/merge: No such file or directory
! ff85f45...bef390f refs/pull/618/merge -> origin/pr/618/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/682/merge: No such file or directory
! 74ed1e8...5a4558b refs/pull/682/merge -> origin/pr/682/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/727/merge: No such file or directory
! d20a818...9dea77a refs/pull/727/merge -> origin/pr/727/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/728/merge: No such file or directory
! ad97d7e...6a2c66f refs/pull/728/merge -> origin/pr/728/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/732/merge: No such file or directory
! 9161b26...4e32f69 refs/pull/732/merge -> origin/pr/732/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/740/merge: No such file or directory
! 69ac523...5faa7e1 refs/pull/740/merge -> origin/pr/740/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8a00f225454bcc742e5b38a499237bd5de455fb7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8a00f225454bcc742e5b38a499237bd5de455fb7
> git rev-list 57929fb802d0cb6a6b6c3f14819d473dc2ace113 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson855294298243729482.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2762815817616975954.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3848627904993101890.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1824862734094644161.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 12:02:27,362 10f41cb0 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/10f41cb0/pkb.log
2017-04-19 12:02:27,362 10f41cb0 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 12:02:27,363 10f41cb0 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 12:02:27,689 10f41cb0 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 12:02:27,781 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 12:02:27,783 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 12:02:27,784 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 12:02:27,792 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 12:02:27,794 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 12:02:27,840 10f41cb0 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 12:02:27,840 10f41cb0 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/10f41cb0/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #326
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/326/display/redirect?page=changes>
Changes:
[dhalperi] Delete deprecated AttemptAndTimeBoundedExponentialBackoff
[dhalperi] Remove deprecated method in IOChannelUtils
[dhalperi] Remove deprecated/unused code from Pipeline
[dhalperi] Delete AttemptBoundedExponentialBackoff
[dhalperi] Delete IntervalBoundedExponentialBackoff
[dhalperi] Delete AppEngineEnvironment
[dhalperi] Upgrade worker to not depend on deprecated now deleted code
[dhalperi] Changed snappy version to 1.1.4-M3
[kirpichov] Separates side input test and side output test
[kirpichov] ProcessFn remembers more info about its application context
[kirpichov] Minor cleanups in ParDoEvaluator
[kirpichov] Extracts interface from PushbackSideInputDoFnRunner
[kirpichov] Creates ProcessFnRunner and wires it through ParDoEvaluator
[kirpichov] Explodes windows before GBKIKWI
[kirpichov] Use tableRefFunction throughout BigQueryIO. Constant table writes use
[kirpichov] Add PrepareWrite transform.
[kirpichov] Refactor streaming write branch into separate reusable components.
[kirpichov] Refactor batch load job path, and add support for data-dependent tables.
[kirpichov] Refactor batch loads, and add support for windowed writes.
[kirpichov] Fix tests to properly fake out BigQueryService, and add tests for
[kirpichov] Separate streaming writes into two pluggable components - CreateTables,
------------------------------------------
[...truncated 273.30 KB...]
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 3490028...04ca87a refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2576/merge -> origin/pr/2576/merge
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2584/merge -> origin/pr/2584/merge
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! 19675f4...33b68a2 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/311/merge: No such file or directory
! b1b5420...38f43c8 refs/pull/311/merge -> origin/pr/311/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/314/merge: No such file or directory
! 049852e...387f0d0 refs/pull/314/merge -> origin/pr/314/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/373/merge: No such file or directory
! b76a439...e477b34 refs/pull/373/merge -> origin/pr/373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/405/merge: No such file or directory
! 49c7afb...53cc1f3 refs/pull/405/merge -> origin/pr/405/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/439/merge: No such file or directory
! 7316fec...1af3a6a refs/pull/439/merge -> origin/pr/439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/455/merge: No such file or directory
! 895dfbd...0cb45d9 refs/pull/455/merge -> origin/pr/455/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/456/merge: No such file or directory
! afdd93d...9f247c6 refs/pull/456/merge -> origin/pr/456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/477/merge: No such file or directory
! 0072b18...e6a7374 refs/pull/477/merge -> origin/pr/477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/478/merge: No such file or directory
! e6d165e...99723f9 refs/pull/478/merge -> origin/pr/478/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/501/merge: No such file or directory
! 774a826...1465309 refs/pull/501/merge -> origin/pr/501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/506/merge: No such file or directory
! b8b554c...10d253a refs/pull/506/merge -> origin/pr/506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/511/merge: No such file or directory
! 4e29989...7d39fcd refs/pull/511/merge -> origin/pr/511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/515/merge: No such file or directory
! 330a4ce...dd58944 refs/pull/515/merge -> origin/pr/515/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/541/merge: No such file or directory
! 359ac26...600cfee refs/pull/541/merge -> origin/pr/541/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/572/merge: No such file or directory
! 026ae3c...dfe226f refs/pull/572/merge -> origin/pr/572/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/577/merge: No such file or directory
! ebba24a...649c63b refs/pull/577/merge -> origin/pr/577/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/583/merge: No such file or directory
! 3ba48ca...1525173 refs/pull/583/merge -> origin/pr/583/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/586/merge: No such file or directory
! 4657dbe...52f541b refs/pull/586/merge -> origin/pr/586/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! f5b7f08...3af926b refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 57929fb802d0cb6a6b6c3f14819d473dc2ace113 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 57929fb802d0cb6a6b6c3f14819d473dc2ace113
> git rev-list 6d3fe51ce3240cea54e01cb61723f1547039904d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4777849911207284166.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1618973676818635769.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2986352072992804019.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3477464880998356108.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 06:02:25,873 027dd7cc MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/027dd7cc/pkb.log
2017-04-19 06:02:25,874 027dd7cc MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 06:02:25,875 027dd7cc MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 06:02:26,538 027dd7cc MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 06:02:26,700 027dd7cc MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 06:02:26,814 027dd7cc MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 06:02:26,815 027dd7cc MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 06:02:26,821 027dd7cc MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 06:02:26,823 027dd7cc MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 06:02:26,836 027dd7cc MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 06:02:26,837 027dd7cc MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/027dd7cc/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #325
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/325/display/redirect?page=changes>
Changes:
[kirpichov] Revert "Removes final minor usages of OldDoFn outside OldDoFn itself"
[dhalperi] [BEAM-1272] Align the naming of "generateInitialSplits" and
[kirpichov] [BEAM-1990] Comment: Don't use Window.Assign
[tgroh] Rename SideOutputValue to OutputValue
[dhalperi] runners-core-construction-java fix artifact name
[kirpichov] Gets rid of TFRecordIO.Read.Bound
[kirpichov] Converts TFRecordIO.Read to AutoValue
[kirpichov] Gets rid of TFRecordIO.Write.Bound
[kirpichov] Converts TFRecordIO.Write to AutoValue
[kirpichov] Removes unused validation parameter
[altay] Revert "Revert "Revert "Revert "Add ValueProvider class for
[altay] Revert "Revert "Throw specialized exception in value providers""
[altay] Remove options_id concept from templated runs.
[altay] [BEAM-1964] Upgrade Pylint
[lcwik] [BEAM-1871] Create new GCP core module package and move several GCP
------------------------------------------
[...truncated 217.71 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6d3fe51ce3240cea54e01cb61723f1547039904d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6d3fe51ce3240cea54e01cb61723f1547039904d
> git rev-list 8f4bb0158cecb8c4144766706fa9d70b094fc88d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1329739036196276955.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5801673408767828225.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5168717403391126895.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2981690994877704682.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 00:03:17,038 b91b9bc2 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b91b9bc2/pkb.log
2017-04-19 00:03:17,038 b91b9bc2 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 00:03:17,039 b91b9bc2 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 00:03:17,628 b91b9bc2 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 00:03:17,740 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 00:03:17,744 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 00:03:17,744 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 00:03:17,751 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 00:03:17,754 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 00:03:17,765 b91b9bc2 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 00:03:17,766 b91b9bc2 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b91b9bc2/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #324
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/324/display/redirect?page=changes>
Changes:
[iemejia] Enable flink dependency enforcement and make dependencies explicit
[iemejia] Fix Javadoc warnings on Flink Runner
[iemejia] Remove flink-annotations dependency
[iemejia] [BEAM-1993] Remove special unbounded Flink source/sink
[tgroh] Translate PTransforms to and from Runner API Protos
[altay] Clean up DirectRunner Clock and TransformResult
[altay] Remove overloading of __call__ in DirectRunner
[altay] Making metrics usage in datastore_wordcount consistent
[dhalperi] Fix Hadoop pom.xml
------------------------------------------
[...truncated 261.99 KB...]
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/head: No such file or directory
! 89d82a1..8c5778e refs/pull/2549/head -> origin/pr/2549/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 8278987...3490028 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2568/merge -> origin/pr/2568/merge
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2576/merge -> origin/pr/2576/merge
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
error: unable to resolve reference refs/remotes/origin/pr/278/merge: No such file or directory
! 4c5e015...0d23148 refs/pull/278/merge -> origin/pr/278/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/284/merge: No such file or directory
! 5d30780...da52238 refs/pull/284/merge -> origin/pr/284/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 79eade4...f5b7f08 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8f4bb0158cecb8c4144766706fa9d70b094fc88d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8f4bb0158cecb8c4144766706fa9d70b094fc88d
> git rev-list e5568589cab11399126f678ad3fbca4b1fb715e4 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8901619799384700904.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6553407579883199676.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2767305992257758221.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1924418183473579911.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 18:02:36,580 64a3ea9e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/64a3ea9e/pkb.log
2017-04-18 18:02:36,586 64a3ea9e MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 18:02:36,587 64a3ea9e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 18:02:37,016 64a3ea9e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 18:02:37,133 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 18:02:37,135 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 18:02:37,135 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 18:02:37,140 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 18:02:37,142 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 18:02:37,166 64a3ea9e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 18:02:37,166 64a3ea9e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/64a3ea9e/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #323
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/323/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-59] Register standard FileSystems wherever we register
------------------------------------------
[...truncated 258.28 KB...]
! d965a1a...43d8ac2 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! ee99a31...397b97d refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! bef69b5...2eef1fd refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 366bf52...8456a6d refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! c7c0bed...a3b43b6 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 431c487...214205d refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 1202743...5882b32 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 5650c43...8278987 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2568/merge -> origin/pr/2568/merge
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
error: unable to resolve reference refs/remotes/origin/pr/50/merge: No such file or directory
! 6f23618...9372791 refs/pull/50/merge -> origin/pr/50/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 6431456...79eade4 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/74/merge: No such file or directory
! b91b760...4562339 refs/pull/74/merge -> origin/pr/74/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/75/merge: No such file or directory
! e7cccaa...5331059 refs/pull/75/merge -> origin/pr/75/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e5568589cab11399126f678ad3fbca4b1fb715e4 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e5568589cab11399126f678ad3fbca4b1fb715e4
> git rev-list c52ce7c4bd952d943bccb8acff53b36b40c35428 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson39426978036214425.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5796789730107017061.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8375130796706901326.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6295393925086791677.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 12:02:18,566 d1d4b765 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d1d4b765/pkb.log
2017-04-18 12:02:18,566 d1d4b765 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 12:02:18,566 d1d4b765 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 12:02:18,882 d1d4b765 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 12:02:18,962 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 12:02:18,964 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 12:02:18,964 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 12:02:18,969 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 12:02:18,970 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 12:02:19,001 d1d4b765 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 12:02:19,001 d1d4b765 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d1d4b765/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #322
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/322/display/redirect?page=changes>
Changes:
[dhalperi] Only compile HIFIO ITs when compiling with java 8.
[tgroh] Set the Project of a Table Reference at Runtime
[altay] clean up description for sdk_location
[dhalperi] [BEAM-1991] Sum.SumDoubleFn => Sum.ofDoubles
------------------------------------------
[...truncated 263.13 KB...]
! 1c56862...d62e965 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 768927c...34bb7be refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! cb3f078...68b5b7a refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! a5be5fb...4e96823 refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! e135c9d...302aad6 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 652890a...649e96c refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! ae069b8...3ed695f refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 33fc584...366bf52 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! fc37405...c7c0bed refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! a700cb0...431c487 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 7b2c6ca...1202743 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! ead989f...38a153f refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 70aebaf...db83b85 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 9aec98c...8f11c5b refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 7be646c...5650c43 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2568/merge -> origin/pr/2568/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 1c5a0e0...6431456 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c52ce7c4bd952d943bccb8acff53b36b40c35428 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c52ce7c4bd952d943bccb8acff53b36b40c35428
> git rev-list 4ff244d49c678f658f437600559cbe0a99048f81 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7242308831951486378.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7246019932213222086.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3384791478864205582.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9142746497036719553.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 06:01:59,996 957bfc7b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/957bfc7b/pkb.log
2017-04-18 06:01:59,996 957bfc7b MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 06:01:59,997 957bfc7b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 06:02:00,103 957bfc7b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 06:02:00,187 957bfc7b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 06:02:00,190 957bfc7b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 06:02:00,190 957bfc7b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 06:02:00,197 957bfc7b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 06:02:00,199 957bfc7b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 06:02:00,221 957bfc7b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 06:02:00,221 957bfc7b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/957bfc7b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #321
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/321/display/redirect?page=changes>
Changes:
[tgroh] Remove reference to the isStreaming flag
[tgroh] Remove getSideInputWindow
[altay] Add no-else return to pylintrc
[chamikara] Update assertions of source_test_utils from camelcase to
------------------------------------------
[...truncated 255.61 KB...]
! 6777f68...e7b72b0 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2316/merge: No such file or directory
! fc0d1a7...9d9cbc5 refs/pull/2316/merge -> origin/pr/2316/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2330/merge: No such file or directory
! 03a7191...dc28d6a refs/pull/2330/merge -> origin/pr/2330/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 63c0b96...4be264d refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/head: No such file or directory
! a95e0a3..bfd7c69 refs/pull/2339/head -> origin/pr/2339/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 4d9e094...ea7f091 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! e458904...ad8ef4a refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! f74af87...4370eb0 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 49d6432...09fbed7 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/head: No such file or directory
! 3e3b510..09923b3 refs/pull/2417/head -> origin/pr/2417/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 4cc17f8...687a6f6 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! e3c990d...451130b refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! a4dbb92...2634824 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! e2506ce...3c9ed06 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! ceeb9d5...ffc6bdf refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 13f53f2...fa45070 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! a993257...b7a2dd1 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! 9f62c44...76cd8aa refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 1e0fb0f...33fc584 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! e65f319...fc37405 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! accb33b...a700cb0 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! e55db78...7b2c6ca refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! b94d459...ead989f refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 6f90c52...70aebaf refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 1760aeb...9aec98c refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! ad1a102...7be646c refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 3607de7...1c5a0e0 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4ff244d49c678f658f437600559cbe0a99048f81 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4ff244d49c678f658f437600559cbe0a99048f81
> git rev-list 8302783c3239ddcf8b5259b4aff8ee33673d02cd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4475637422229182291.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5889208407194751846.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7039340731844299852.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1137852464107757677.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 00:02:07,135 30a3becb MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/30a3becb/pkb.log
2017-04-18 00:02:07,136 30a3becb MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 00:02:07,136 30a3becb MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 00:02:07,273 30a3becb MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 00:02:07,358 30a3becb MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 00:02:07,361 30a3becb MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 00:02:07,361 30a3becb MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 00:02:07,367 30a3becb MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 00:02:07,370 30a3becb MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 00:02:07,398 30a3becb MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 00:02:07,398 30a3becb MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/30a3becb/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #320
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/320/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-1922] Close datasource in JdbcIO when possible
[tgroh] Update Dataflow Worker Version
[kirpichov] Javadoc fixups after style guide changes
------------------------------------------
[...truncated 258.35 KB...]
! c284b62...4ea7285 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! fc7e7c8...351df3a refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 22c3670...8923027 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 0fdba7c...c05b468 refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/head: No such file or directory
! 83bad83..3e3b510 refs/pull/2417/head -> origin/pr/2417/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 5eed698...4cc17f8 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2418/merge: No such file or directory
! 736dcc8...26d171e refs/pull/2418/merge -> origin/pr/2418/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 87cf1fe...e3c990d refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! cccd360...a4dbb92 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! bc3fb2f...3e6a75f refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 498d04f...6c488c2 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! ebb426d...76a6c17 refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! cd94a1d...ccb7a55 refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! dc8b790...45f2cae refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 722ca8e...e2506ce refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! b78575c...23b0870 refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 9dca2eb...5ff71d3 refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 3b8ec12...2094a82 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 1843110...ceeb9d5 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! eba7225...13f53f2 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! a8f1836...a993257 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 7534645...b1e3c5a refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 6b2b994...df85b9f refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! e0953a7...e5ccd7c refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! a6753b1...9f62c44 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! a11307a...1c56862 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! c7b289b...e135c9d refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 29cae96...652890a refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 1391cd4...1e0fb0f refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 0baa476...e65f319 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 0f3f9d2...accb33b refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 4f2eee1...ad1a102 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! dd8a5f2...3607de7 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8302783c3239ddcf8b5259b4aff8ee33673d02cd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8302783c3239ddcf8b5259b4aff8ee33673d02cd
> git rev-list 946778c5bb114814d1ba5ebe71a27bc960f9e59b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4430182060932767693.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1234025568128931991.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8578646212994847135.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4904381690154377724.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 18:01:50,094 7f2ef3cf MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/7f2ef3cf/pkb.log
2017-04-17 18:01:50,094 7f2ef3cf MainThread INFO PerfKitBenchmarker version: v1.11.0-42-g4158261
2017-04-17 18:01:50,095 7f2ef3cf MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 18:01:50,430 7f2ef3cf MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 18:01:50,509 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 18:01:50,511 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 18:01:50,511 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 18:01:50,516 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 18:01:50,518 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 18:01:50,548 7f2ef3cf MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 18:01:50,548 7f2ef3cf MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/7f2ef3cf/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #319
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/319/display/redirect?page=changes>
Changes:
[jbonofre] Add javadoc to getCheckpointMark in UnboundedSource
[jbonofre] Fix javadoc warnings
------------------------------------------
[...truncated 255.50 KB...]
! 502da88...9363e9c refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! b0a00bd...e461807 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! bec8d58...26007e0 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! eefcb75...1207e61 refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! c53a4a4...e8b15dd refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! acb155f...422e309 refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 1e28b4d...a8882d5 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 7f686a9...5ad8a93 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2330/merge: No such file or directory
! 6a9103e...40050d1 refs/pull/2330/merge -> origin/pr/2330/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 890d1ed...0c05446 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 36cb659...670a00b refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! b0927d5...3e33bf1 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 8524d7b...5131c76 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 457cc80...e11f424 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 0ec058e...8b35a5d refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 557cdc4...5eed698 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 92f1d8c...87cf1fe refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! ae4da02...cccd360 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! f597223...722ca8e refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! d158c14...1843110 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 1eb04db...eba7225 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! c20273c...a8f1836 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! b1b8c98...7534645 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! 10bd14d...a6753b1 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! d8b33d0...ae069b8 refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 9cc3ca0...1391cd4 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 0f89790...0baa476 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! aed3bb9...0f3f9d2 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 9cc4e4d...e55db78 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! d646411...b94d459 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 1fdb7fe...6f90c52 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 4967edf...1760aeb refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! eac251b...4f2eee1 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 60d65b7...dd8a5f2 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 946778c5bb114814d1ba5ebe71a27bc960f9e59b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 946778c5bb114814d1ba5ebe71a27bc960f9e59b
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2183302179321813950.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3671284807063179629.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5450963157070791769.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4835424911024664160.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 12:01:55,812 551eb6c1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/551eb6c1/pkb.log
2017-04-17 12:01:55,813 551eb6c1 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-17 12:01:55,813 551eb6c1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 12:01:56,289 551eb6c1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 12:01:56,369 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 12:01:56,371 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 12:01:56,372 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 12:01:56,376 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 12:01:56,378 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 12:01:56,407 551eb6c1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 12:01:56,408 551eb6c1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/551eb6c1/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #318
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/318/display/redirect>
------------------------------------------
[...truncated 237.35 KB...]
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 2358, done.
remote: Compressing objects: 0% (1/221) remote: Compressing objects: 1% (3/221) remote: Compressing objects: 2% (5/221) remote: Compressing objects: 3% (7/221) remote: Compressing objects: 4% (9/221) remote: Compressing objects: 5% (12/221) remote: Compressing objects: 6% (14/221) remote: Compressing objects: 7% (16/221) remote: Compressing objects: 8% (18/221) remote: Compressing objects: 9% (20/221) remote: Compressing objects: 10% (23/221) remote: Compressing objects: 11% (25/221) remote: Compressing objects: 12% (27/221) remote: Compressing objects: 13% (29/221) remote: Compressing objects: 14% (31/221) remote: Compressing objects: 15% (34/221) remote: Compressing objects: 16% (36/221) remote: Compressing objects: 17% (38/221) remote: Compressing objects: 18% (40/221) remote: Compressing objects: 19% (42/221) remote: Compressing objects: 20% (45/221) remote: Compressing objects: 21% (47/221) remote: Compressing objects: 22% (49/221) remote: Compressing objects: 23% (51/221) remote: Compressing objects: 24% (54/221) remote: Compressing objects: 25% (56/221) remote: Compressing objects: 26% (58/221) remote: Compressing objects: 27% (60/221) remote: Compressing objects: 28% (62/221) remote: Compressing objects: 29% (65/221) remote: Compressing objects: 30% (67/221) remote: Compressing objects: 31% (69/221) remote: Compressing objects: 32% (71/221) remote: Compressing objects: 33% (73/221) remote: Compressing objects: 34% (76/221) remote: Compressing objects: 35% (78/221) remote: Compressing objects: 36% (80/221) remote: Compressing objects: 37% (82/221) remote: Compressing objects: 38% (84/221) remote: Compressing objects: 39% (87/221) remote: Compressing objects: 40% (89/221) remote: Compressing objects: 41% (91/221) remote: Compressing objects: 42% (93/221) remote: Compressing objects: 43% (96/221) remote: Compressing objects: 44% (98/221) remote: Compressing objects: 45% (100/221) remote: Compressing objects: 46% (102/221) remote: Compressing objects: 47% (104/221) remote: Compressing objects: 48% (107/221) remote: Compressing objects: 49% (109/221) remote: Compressing objects: 50% (111/221) remote: Compressing objects: 51% (113/221) remote: Compressing objects: 52% (115/221) remote: Compressing objects: 53% (118/221) remote: Compressing objects: 54% (120/221) remote: Compressing objects: 55% (122/221) remote: Compressing objects: 56% (124/221) remote: Compressing objects: 57% (126/221) remote: Compressing objects: 58% (129/221) remote: Compressing objects: 59% (131/221) remote: Compressing objects: 60% (133/221) remote: Compressing objects: 61% (135/221) remote: Compressing objects: 62% (138/221) remote: Compressing objects: 63% (140/221) remote: Compressing objects: 64% (142/221) remote: Compressing objects: 65% (144/221) remote: Compressing objects: 66% (146/221) remote: Compressing objects: 67% (149/221) remote: Compressing objects: 68% (151/221) remote: Compressing objects: 69% (153/221) remote: Compressing objects: 70% (155/221) remote: Compressing objects: 71% (157/221) remote: Compressing objects: 72% (160/221) remote: Compressing objects: 73% (162/221) remote: Compressing objects: 74% (164/221) remote: Compressing objects: 75% (166/221) remote: Compressing objects: 76% (168/221) remote: Compressing objects: 77% (171/221) remote: Compressing objects: 78% (173/221) remote: Compressing objects: 79% (175/221) remote: Compressing objects: 80% (177/221) remote: Compressing objects: 81% (180/221) remote: Compressing objects: 82% (182/221) remote: Compressing objects: 83% (184/221) remote: Compressing objects: 84% (186/221) remote: Compressing objects: 85% (188/221) remote: Compressing objects: 86% (191/221) remote: Compressing objects: 87% (193/221) remote: Compressing objects: 88% (195/221) remote: Compressing objects: 89% (197/221) remote: Compressing objects: 90% (199/221) remote: Compressing objects: 91% (202/221) remote: Compressing objects: 92% (204/221) remote: Compressing objects: 93% (206/221) remote: Compressing objects: 94% (208/221) remote: Compressing objects: 95% (210/221) remote: Compressing objects: 96% (213/221) remote: Compressing objects: 97% (215/221) remote: Compressing objects: 98% (217/221) remote: Compressing objects: 99% (219/221) remote: Compressing objects: 100% (221/221) remote: Compressing objects: 100% (221/221), done.
Receiving objects: 0% (1/2358) Receiving objects: 1% (24/2358) Receiving objects: 2% (48/2358) Receiving objects: 3% (71/2358) Receiving objects: 4% (95/2358) Receiving objects: 5% (118/2358) Receiving objects: 6% (142/2358) Receiving objects: 7% (166/2358) Receiving objects: 8% (189/2358) Receiving objects: 9% (213/2358) Receiving objects: 10% (236/2358) Receiving objects: 11% (260/2358) Receiving objects: 12% (283/2358) Receiving objects: 13% (307/2358) Receiving objects: 14% (331/2358) Receiving objects: 15% (354/2358) Receiving objects: 16% (378/2358) Receiving objects: 17% (401/2358) Receiving objects: 18% (425/2358) Receiving objects: 19% (449/2358) Receiving objects: 20% (472/2358) Receiving objects: 21% (496/2358) Receiving objects: 22% (519/2358) Receiving objects: 23% (543/2358) Receiving objects: 24% (566/2358) Receiving objects: 25% (590/2358) Receiving objects: 26% (614/2358) Receiving objects: 27% (637/2358) Receiving objects: 28% (661/2358) Receiving objects: 29% (684/2358) Receiving objects: 30% (708/2358) Receiving objects: 31% (731/2358) Receiving objects: 32% (755/2358) Receiving objects: 33% (779/2358) Receiving objects: 34% (802/2358) Receiving objects: 35% (826/2358) Receiving objects: 36% (849/2358) Receiving objects: 37% (873/2358) Receiving objects: 38% (897/2358) Receiving objects: 39% (920/2358) Receiving objects: 40% (944/2358) Receiving objects: 41% (967/2358) Receiving objects: 42% (991/2358) Receiving objects: 43% (1014/2358) Receiving objects: 44% (1038/2358) Receiving objects: 45% (1062/2358) Receiving objects: 46% (1085/2358) Receiving objects: 47% (1109/2358) Receiving objects: 48% (1132/2358) Receiving objects: 49% (1156/2358) Receiving objects: 50% (1179/2358) Receiving objects: 51% (1203/2358) Receiving objects: 52% (1227/2358) Receiving objects: 53% (1250/2358) Receiving objects: 54% (1274/2358) Receiving objects: 55% (1297/2358) Receiving objects: 56% (1321/2358) Receiving objects: 57% (1345/2358) Receiving objects: 58% (1368/2358) Receiving objects: 59% (1392/2358) Receiving objects: 60% (1415/2358) Receiving objects: 61% (1439/2358) Receiving objects: 62% (1462/2358) Receiving objects: 63% (1486/2358) Receiving objects: 64% (1510/2358) Receiving objects: 65% (1533/2358) Receiving objects: 66% (1557/2358) Receiving objects: 67% (1580/2358) Receiving objects: 68% (1604/2358) Receiving objects: 69% (1628/2358) Receiving objects: 70% (1651/2358) Receiving objects: 71% (1675/2358) Receiving objects: 72% (1698/2358) Receiving objects: 73% (1722/2358) Receiving objects: 74% (1745/2358) Receiving objects: 75% (1769/2358) Receiving objects: 76% (1793/2358) Receiving objects: 77% (1816/2358) Receiving objects: 78% (1840/2358) Receiving objects: 79% (1863/2358) Receiving objects: 80% (1887/2358) Receiving objects: 81% (1910/2358) Receiving objects: 82% (1934/2358) Receiving objects: 83% (1958/2358) Receiving objects: 84% (1981/2358) Receiving objects: 85% (2005/2358) Receiving objects: 86% (2028/2358) Receiving objects: 87% (2052/2358) Receiving objects: 88% (2076/2358) Receiving objects: 89% (2099/2358) Receiving objects: 90% (2123/2358) Receiving objects: 91% (2146/2358) Receiving objects: 92% (2170/2358) Receiving objects: 93% (2193/2358) Receiving objects: 94% (2217/2358) Receiving objects: 95% (2241/2358) remote: Total 2358 (delta 850), reused 758 (delta 758), pack-reused 1273
Receiving objects: 96% (2264/2358) Receiving objects: 97% (2288/2358) Receiving objects: 98% (2311/2358) Receiving objects: 99% (2335/2358) Receiving objects: 100% (2358/2358) Receiving objects: 100% (2358/2358), 330.71 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/887) Resolving deltas: 1% (9/887) Resolving deltas: 2% (19/887) Resolving deltas: 3% (30/887) Resolving deltas: 4% (37/887) Resolving deltas: 5% (49/887) Resolving deltas: 6% (56/887) Resolving deltas: 7% (64/887) Resolving deltas: 9% (82/887) Resolving deltas: 10% (91/887) Resolving deltas: 11% (98/887) Resolving deltas: 12% (107/887) Resolving deltas: 14% (129/887) Resolving deltas: 15% (138/887) Resolving deltas: 17% (152/887) Resolving deltas: 18% (163/887) Resolving deltas: 22% (196/887) Resolving deltas: 23% (206/887) Resolving deltas: 24% (217/887) Resolving deltas: 25% (223/887) Resolving deltas: 26% (232/887) Resolving deltas: 27% (240/887) Resolving deltas: 28% (250/887) Resolving deltas: 29% (258/887) Resolving deltas: 30% (267/887) Resolving deltas: 31% (276/887) Resolving deltas: 32% (284/887) Resolving deltas: 33% (295/887) Resolving deltas: 34% (303/887) Resolving deltas: 35% (313/887) Resolving deltas: 36% (320/887) Resolving deltas: 37% (329/887) Resolving deltas: 38% (339/887) Resolving deltas: 39% (351/887) Resolving deltas: 40% (355/887) Resolving deltas: 41% (364/887) Resolving deltas: 42% (380/887) Resolving deltas: 43% (383/887) Resolving deltas: 44% (393/887) Resolving deltas: 45% (405/887) Resolving deltas: 46% (410/887) Resolving deltas: 48% (426/887) Resolving deltas: 49% (435/887) Resolving deltas: 50% (444/887) Resolving deltas: 51% (454/887) Resolving deltas: 52% (467/887) Resolving deltas: 53% (472/887) Resolving deltas: 54% (479/887) Resolving deltas: 55% (488/887) Resolving deltas: 56% (497/887) Resolving deltas: 57% (506/887) Resolving deltas: 58% (517/887) Resolving deltas: 59% (525/887) Resolving deltas: 60% (533/887) Resolving deltas: 61% (542/887) Resolving deltas: 62% (550/887) Resolving deltas: 63% (560/887) Resolving deltas: 64% (568/887) Resolving deltas: 65% (578/887) Resolving deltas: 66% (586/887) Resolving deltas: 67% (596/887) Resolving deltas: 68% (604/887) Resolving deltas: 69% (614/887) Resolving deltas: 70% (622/887) Resolving deltas: 71% (630/887) Resolving deltas: 72% (640/887) Resolving deltas: 73% (649/887) Resolving deltas: 74% (657/887) Resolving deltas: 75% (667/887) Resolving deltas: 76% (676/887) Resolving deltas: 77% (686/887) Resolving deltas: 78% (694/887) Resolving deltas: 79% (703/887) Resolving deltas: 80% (710/887) Resolving deltas: 81% (720/887) Resolving deltas: 82% (728/887) Resolving deltas: 83% (738/887) Resolving deltas: 84% (746/887) Resolving deltas: 85% (755/887) Resolving deltas: 86% (763/887) Resolving deltas: 87% (773/887) Resolving deltas: 88% (781/887) Resolving deltas: 89% (790/887) Resolving deltas: 90% (799/887) Resolving deltas: 91% (808/887) Resolving deltas: 92% (818/887) Resolving deltas: 93% (825/887) Resolving deltas: 94% (837/887) Resolving deltas: 95% (843/887) Resolving deltas: 96% (853/887) Resolving deltas: 97% (861/887) Resolving deltas: 98% (870/887) Resolving deltas: 99% (879/887) Resolving deltas: 100% (887/887) Resolving deltas: 100% (887/887), completed with 348 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2357/merge: No such file or directory
! 5bb5b6d...ef7fb12 refs/pull/2357/merge -> origin/pr/2357/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! 251f88d...49f6c1a refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! 33d8a6e...fc7e7c8 refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 4cc83d7...6a173ff refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! 7f95e55...e77af3d refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2403/merge: No such file or directory
! e9bf169...d3466d6 refs/pull/2403/merge -> origin/pr/2403/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 6c783c7...97b8bb7 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2464/merge: No such file or directory
! d4e537d...3f5fdfa refs/pull/2464/merge -> origin/pr/2464/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! a9ffe52...768927c refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 7079a6f...1fdb7fe refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6552707196228450310.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6315119123645863314.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2535287405528515827.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2000769867364109042.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 06:01:47,308 30b4bb3a MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/30b4bb3a/pkb.log
2017-04-17 06:01:47,308 30b4bb3a MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-17 06:01:47,309 30b4bb3a MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 06:01:47,768 30b4bb3a MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 06:01:48,081 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 06:01:48,083 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 06:01:48,083 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 06:01:48,088 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 06:01:48,090 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 06:01:48,117 30b4bb3a MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 06:01:48,117 30b4bb3a MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/30b4bb3a/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #317
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/317/display/redirect>
------------------------------------------
[...truncated 236.50 KB...]
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 2061, done.
remote: Compressing objects: 0% (1/232) remote: Compressing objects: 1% (3/232) remote: Compressing objects: 2% (5/232) remote: Compressing objects: 3% (7/232) remote: Compressing objects: 4% (10/232) remote: Compressing objects: 5% (12/232) remote: Compressing objects: 6% (14/232) remote: Compressing objects: 7% (17/232) remote: Compressing objects: 8% (19/232) remote: Compressing objects: 9% (21/232) remote: Compressing objects: 10% (24/232) remote: Compressing objects: 11% (26/232) remote: Compressing objects: 12% (28/232) remote: Compressing objects: 13% (31/232) remote: Compressing objects: 14% (33/232) remote: Compressing objects: 15% (35/232) remote: Compressing objects: 16% (38/232) remote: Compressing objects: 17% (40/232) remote: Compressing objects: 18% (42/232) remote: Compressing objects: 19% (45/232) remote: Compressing objects: 20% (47/232) remote: Compressing objects: 21% (49/232) remote: Compressing objects: 22% (52/232) remote: Compressing objects: 23% (54/232) remote: Compressing objects: 24% (56/232) remote: Compressing objects: 25% (58/232) remote: Compressing objects: 26% (61/232) remote: Compressing objects: 27% (63/232) remote: Compressing objects: 28% (65/232) remote: Compressing objects: 29% (68/232) remote: Compressing objects: 30% (70/232) remote: Compressing objects: 31% (72/232) remote: Compressing objects: 32% (75/232) remote: Compressing objects: 33% (77/232) remote: Compressing objects: 34% (79/232) remote: Compressing objects: 35% (82/232) remote: Compressing objects: 36% (84/232) remote: Compressing objects: 37% (86/232) remote: Compressing objects: 38% (89/232) remote: Compressing objects: 39% (91/232) remote: Compressing objects: 40% (93/232) remote: Compressing objects: 41% (96/232) remote: Compressing objects: 42% (98/232) remote: Compressing objects: 43% (100/232) remote: Compressing objects: 44% (103/232) remote: Compressing objects: 45% (105/232) remote: Compressing objects: 46% (107/232) remote: Compressing objects: 47% (110/232) remote: Compressing objects: 48% (112/232) remote: Compressing objects: 49% (114/232) remote: Compressing objects: 50% (116/232) remote: Compressing objects: 51% (119/232) remote: Compressing objects: 52% (121/232) remote: Compressing objects: 53% (123/232) remote: Compressing objects: 54% (126/232) remote: Compressing objects: 55% (128/232) remote: Compressing objects: 56% (130/232) remote: Compressing objects: 57% (133/232) remote: Compressing objects: 58% (135/232) remote: Compressing objects: 59% (137/232) remote: Compressing objects: 60% (140/232) remote: Compressing objects: 61% (142/232) remote: Compressing objects: 62% (144/232) remote: Compressing objects: 63% (147/232) remote: Compressing objects: 64% (149/232) remote: Compressing objects: 65% (151/232) remote: Compressing objects: 66% (154/232) remote: Compressing objects: 67% (156/232) remote: Compressing objects: 68% (158/232) remote: Compressing objects: 69% (161/232) remote: Compressing objects: 70% (163/232) remote: Compressing objects: 71% (165/232) remote: Compressing objects: 72% (168/232) remote: Compressing objects: 73% (170/232) remote: Compressing objects: 74% (172/232) remote: Compressing objects: 75% (174/232) remote: Compressing objects: 76% (177/232) remote: Compressing objects: 77% (179/232) remote: Compressing objects: 78% (181/232) remote: Compressing objects: 79% (184/232) remote: Compressing objects: 80% (186/232) remote: Compressing objects: 81% (188/232) remote: Compressing objects: 82% (191/232) remote: Compressing objects: 83% (193/232) remote: Compressing objects: 84% (195/232) remote: Compressing objects: 85% (198/232) remote: Compressing objects: 86% (200/232) remote: Compressing objects: 87% (202/232) remote: Compressing objects: 88% (205/232) remote: Compressing objects: 89% (207/232) remote: Compressing objects: 90% (209/232) remote: Compressing objects: 91% (212/232) remote: Compressing objects: 92% (214/232) remote: Compressing objects: 93% (216/232) remote: Compressing objects: 94% (219/232) remote: Compressing objects: 95% (221/232) remote: Compressing objects: 96% (223/232) remote: Compressing objects: 97% (226/232) remote: Compressing objects: 98% (228/232) remote: Compressing objects: 99% (230/232) remote: Compressing objects: 100% (232/232) remote: Compressing objects: 100% (232/232), done.
Receiving objects: 0% (1/2061) Receiving objects: 1% (21/2061) Receiving objects: 2% (42/2061) Receiving objects: 3% (62/2061) Receiving objects: 4% (83/2061) Receiving objects: 5% (104/2061) Receiving objects: 6% (124/2061) Receiving objects: 7% (145/2061) Receiving objects: 8% (165/2061) Receiving objects: 9% (186/2061) Receiving objects: 10% (207/2061) Receiving objects: 11% (227/2061) Receiving objects: 12% (248/2061) Receiving objects: 13% (268/2061) Receiving objects: 14% (289/2061) Receiving objects: 15% (310/2061) Receiving objects: 16% (330/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 17% (351/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 18% (371/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 19% (392/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 20% (413/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 21% (433/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 22% (454/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 23% (475/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 24% (495/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 25% (516/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 26% (536/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 27% (557/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 28% (578/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 29% (598/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 30% (619/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 31% (639/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 32% (660/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 33% (681/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 34% (701/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 35% (722/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 36% (742/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 37% (763/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 38% (784/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 39% (804/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 40% (825/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 41% (846/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 42% (866/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 43% (887/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 44% (907/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 45% (928/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 46% (949/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 46% (964/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 47% (969/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 48% (990/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 49% (1010/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 50% (1031/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 51% (1052/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 52% (1072/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 53% (1093/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 54% (1113/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 55% (1134/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 56% (1155/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 57% (1175/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 58% (1196/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 59% (1216/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 60% (1237/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 61% (1258/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 62% (1278/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 63% (1299/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 64% (1320/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 65% (1340/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 66% (1361/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 67% (1381/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 68% (1402/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 69% (1423/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 70% (1443/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 71% (1464/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 72% (1484/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 73% (1505/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 74% (1526/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 75% (1546/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 76% (1567/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 77% (1587/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 78% (1608/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 79% (1629/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 80% (1649/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 81% (1670/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 82% (1691/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 83% (1711/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 84% (1732/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 85% (1752/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 86% (1773/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 87% (1794/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 88% (1814/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 89% (1835/2061), 72.01 KiB | 64.00 KiB/s remote: Total 2061 (delta 725), reused 631 (delta 631), pack-reused 1073
Receiving objects: 90% (1855/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 91% (1876/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 92% (1897/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 93% (1917/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 94% (1938/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 95% (1958/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 96% (1979/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 97% (2000/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 98% (2020/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 99% (2041/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 100% (2061/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 100% (2061/2061), 340.03 KiB | 64.00 KiB/s, done.
Resolving deltas: 0% (0/751) Resolving deltas: 1% (8/751) Resolving deltas: 2% (17/751) Resolving deltas: 3% (23/751) Resolving deltas: 4% (36/751) Resolving deltas: 5% (42/751) Resolving deltas: 6% (49/751) Resolving deltas: 8% (67/751) Resolving deltas: 9% (73/751) Resolving deltas: 10% (81/751) Resolving deltas: 11% (89/751) Resolving deltas: 12% (91/751) Resolving deltas: 13% (102/751) Resolving deltas: 14% (107/751) Resolving deltas: 15% (115/751) Resolving deltas: 16% (121/751) Resolving deltas: 17% (130/751) Resolving deltas: 18% (141/751) Resolving deltas: 19% (147/751) Resolving deltas: 20% (152/751) Resolving deltas: 23% (175/751) Resolving deltas: 24% (182/751) Resolving deltas: 25% (189/751) Resolving deltas: 26% (196/751) Resolving deltas: 27% (204/751) Resolving deltas: 28% (211/751) Resolving deltas: 29% (218/751) Resolving deltas: 30% (226/751) Resolving deltas: 31% (236/751) Resolving deltas: 32% (243/751) Resolving deltas: 33% (248/751) Resolving deltas: 34% (256/751) Resolving deltas: 35% (264/751) Resolving deltas: 36% (271/751) Resolving deltas: 37% (279/751) Resolving deltas: 38% (288/751) Resolving deltas: 39% (294/751) Resolving deltas: 40% (301/751) Resolving deltas: 41% (309/751) Resolving deltas: 42% (321/751) Resolving deltas: 43% (323/751) Resolving deltas: 44% (332/751) Resolving deltas: 45% (338/751) Resolving deltas: 46% (346/751) Resolving deltas: 47% (353/751) Resolving deltas: 48% (361/751) Resolving deltas: 49% (368/751) Resolving deltas: 50% (376/751) Resolving deltas: 51% (388/751) Resolving deltas: 52% (391/751) Resolving deltas: 53% (399/751) Resolving deltas: 54% (406/751) Resolving deltas: 55% (416/751) Resolving deltas: 56% (423/751) Resolving deltas: 57% (429/751) Resolving deltas: 58% (436/751) Resolving deltas: 59% (445/751) Resolving deltas: 60% (452/751) Resolving deltas: 61% (460/751) Resolving deltas: 62% (466/751) Resolving deltas: 63% (474/751) Resolving deltas: 64% (482/751) Resolving deltas: 65% (490/751) Resolving deltas: 66% (498/751) Resolving deltas: 67% (506/751) Resolving deltas: 68% (514/751) Resolving deltas: 69% (520/751) Resolving deltas: 70% (526/751) Resolving deltas: 71% (535/751) Resolving deltas: 72% (541/751) Resolving deltas: 73% (549/751) Resolving deltas: 74% (556/751) Resolving deltas: 75% (566/751) Resolving deltas: 76% (574/751) Resolving deltas: 77% (580/751) Resolving deltas: 78% (586/751) Resolving deltas: 79% (594/751) Resolving deltas: 80% (602/751) Resolving deltas: 81% (610/751) Resolving deltas: 82% (616/751) Resolving deltas: 83% (624/751) Resolving deltas: 84% (631/751) Resolving deltas: 85% (639/751) Resolving deltas: 86% (647/751) Resolving deltas: 87% (654/751) Resolving deltas: 88% (661/751) Resolving deltas: 89% (669/751) Resolving deltas: 90% (676/751) Resolving deltas: 91% (684/751) Resolving deltas: 92% (692/751) Resolving deltas: 93% (705/751) Resolving deltas: 94% (707/751) Resolving deltas: 95% (714/751) Resolving deltas: 96% (721/751) Resolving deltas: 97% (729/751) Resolving deltas: 98% (738/751) Resolving deltas: 99% (744/751) Resolving deltas: 100% (751/751) Resolving deltas: 100% (751/751), completed with 296 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2330/head: No such file or directory
! 511a130...447306d refs/pull/2330/head -> origin/pr/2330/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2330/merge: No such file or directory
! 5d4c028...6a9103e refs/pull/2330/merge -> origin/pr/2330/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson441205929294293243.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5662280072032797148.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3937865616681008762.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1921353125915777668.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 00:02:34,646 043c10b6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/043c10b6/pkb.log
2017-04-17 00:02:34,646 043c10b6 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-17 00:02:34,647 043c10b6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 00:02:34,889 043c10b6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 00:02:35,055 043c10b6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 00:02:35,059 043c10b6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 00:02:35,059 043c10b6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 00:02:35,069 043c10b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 00:02:35,073 043c10b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 00:02:35,115 043c10b6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 00:02:35,115 043c10b6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/043c10b6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #316
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/316/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8832221214566515910.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5194141463253808259.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3254176213718755422.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4785452911665300387.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 18:00:32,774 32171fa7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/32171fa7/pkb.log
2017-04-16 18:00:32,774 32171fa7 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 18:00:32,775 32171fa7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 18:00:33,051 32171fa7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 18:00:33,135 32171fa7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 18:00:33,137 32171fa7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 18:00:33,138 32171fa7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 18:00:33,142 32171fa7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 18:00:33,144 32171fa7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 18:00:33,170 32171fa7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 18:00:33,171 32171fa7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/32171fa7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #315
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/315/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1649851872837743095.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7042953185599809301.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7033487597033360959.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6530248442843771628.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 12:44:07,682 dc8cbce5 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/dc8cbce5/pkb.log
2017-04-16 12:44:07,683 dc8cbce5 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 12:44:07,683 dc8cbce5 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 12:44:07,843 dc8cbce5 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 12:44:07,922 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 12:44:07,925 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 12:44:07,925 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 12:44:07,929 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 12:44:07,931 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 12:44:07,959 dc8cbce5 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 12:44:07,959 dc8cbce5 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/dc8cbce5/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #314
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/314/display/redirect>
------------------------------------------
[...truncated 236.00 KB...]
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1941, done.
remote: Compressing objects: 0% (1/158) remote: Compressing objects: 1% (2/158) remote: Compressing objects: 2% (4/158) remote: Compressing objects: 3% (5/158) remote: Compressing objects: 4% (7/158) remote: Compressing objects: 5% (8/158) remote: Compressing objects: 6% (10/158) remote: Compressing objects: 7% (12/158) remote: Compressing objects: 8% (13/158) remote: Compressing objects: 9% (15/158) remote: Compressing objects: 10% (16/158) remote: Compressing objects: 11% (18/158) remote: Compressing objects: 12% (19/158) remote: Compressing objects: 13% (21/158) remote: Compressing objects: 14% (23/158) remote: Compressing objects: 15% (24/158) remote: Compressing objects: 16% (26/158) remote: Compressing objects: 17% (27/158) remote: Compressing objects: 18% (29/158) remote: Compressing objects: 19% (31/158) remote: Compressing objects: 20% (32/158) remote: Compressing objects: 21% (34/158) remote: Compressing objects: 22% (35/158) remote: Compressing objects: 23% (37/158) remote: Compressing objects: 24% (38/158) remote: Compressing objects: 25% (40/158) remote: Compressing objects: 26% (42/158) remote: Compressing objects: 27% (43/158) remote: Compressing objects: 28% (45/158) remote: Compressing objects: 29% (46/158) remote: Compressing objects: 30% (48/158) remote: Compressing objects: 31% (49/158) remote: Compressing objects: 32% (51/158) remote: Compressing objects: 33% (53/158) remote: Compressing objects: 34% (54/158) remote: Compressing objects: 35% (56/158) remote: Compressing objects: 36% (57/158) remote: Compressing objects: 37% (59/158) remote: Compressing objects: 38% (61/158) remote: Compressing objects: 39% (62/158) remote: Compressing objects: 40% (64/158) remote: Compressing objects: 41% (65/158) remote: Compressing objects: 42% (67/158) remote: Compressing objects: 43% (68/158) remote: Compressing objects: 44% (70/158) remote: Compressing objects: 45% (72/158) remote: Compressing objects: 46% (73/158) remote: Compressing objects: 47% (75/158) remote: Compressing objects: 48% (76/158) remote: Compressing objects: 49% (78/158) remote: Compressing objects: 50% (79/158) remote: Compressing objects: 51% (81/158) remote: Compressing objects: 52% (83/158) remote: Compressing objects: 53% (84/158) remote: Compressing objects: 54% (86/158) remote: Compressing objects: 55% (87/158) remote: Compressing objects: 56% (89/158) remote: Compressing objects: 57% (91/158) remote: Compressing objects: 58% (92/158) remote: Compressing objects: 59% (94/158) remote: Compressing objects: 60% (95/158) remote: Compressing objects: 61% (97/158) remote: Compressing objects: 62% (98/158) remote: Compressing objects: 63% (100/158) remote: Compressing objects: 64% (102/158) remote: Compressing objects: 65% (103/158) remote: Compressing objects: 66% (105/158) remote: Compressing objects: 67% (106/158) remote: Compressing objects: 68% (108/158) remote: Compressing objects: 69% (110/158) remote: Compressing objects: 70% (111/158) remote: Compressing objects: 71% (113/158) remote: Compressing objects: 72% (114/158) remote: Compressing objects: 73% (116/158) remote: Compressing objects: 74% (117/158) remote: Compressing objects: 75% (119/158) remote: Compressing objects: 76% (121/158) remote: Compressing objects: 77% (122/158) remote: Compressing objects: 78% (124/158) remote: Compressing objects: 79% (125/158) remote: Compressing objects: 80% (127/158) remote: Compressing objects: 81% (128/158) remote: Compressing objects: 82% (130/158) remote: Compressing objects: 83% (132/158) remote: Compressing objects: 84% (133/158) remote: Compressing objects: 85% (135/158) remote: Compressing objects: 86% (136/158) remote: Compressing objects: 87% (138/158) remote: Compressing objects: 88% (140/158) remote: Compressing objects: 89% (141/158) remote: Compressing objects: 90% (143/158) remote: Compressing objects: 91% (144/158) remote: Compressing objects: 92% (146/158) remote: Compressing objects: 93% (147/158) remote: Compressing objects: 94% (149/158) remote: Compressing objects: 95% (151/158) remote: Compressing objects: 96% (152/158) remote: Compressing objects: 97% (154/158) remote: Compressing objects: 98% (155/158) remote: Compressing objects: 99% (157/158) remote: Compressing objects: 100% (158/158) remote: Compressing objects: 100% (158/158), done.
Receiving objects: 0% (1/1941) Receiving objects: 1% (20/1941) Receiving objects: 2% (39/1941) Receiving objects: 3% (59/1941) Receiving objects: 4% (78/1941) Receiving objects: 5% (98/1941) Receiving objects: 6% (117/1941) Receiving objects: 7% (136/1941) Receiving objects: 8% (156/1941) Receiving objects: 9% (175/1941) Receiving objects: 10% (195/1941) Receiving objects: 11% (214/1941) Receiving objects: 12% (233/1941) Receiving objects: 13% (253/1941) Receiving objects: 14% (272/1941) Receiving objects: 15% (292/1941) Receiving objects: 16% (311/1941) Receiving objects: 17% (330/1941) Receiving objects: 18% (350/1941) Receiving objects: 19% (369/1941) Receiving objects: 20% (389/1941) Receiving objects: 21% (408/1941) Receiving objects: 22% (428/1941) Receiving objects: 23% (447/1941) Receiving objects: 24% (466/1941) Receiving objects: 25% (486/1941) Receiving objects: 26% (505/1941) Receiving objects: 27% (525/1941) Receiving objects: 28% (544/1941) Receiving objects: 29% (563/1941) Receiving objects: 30% (583/1941) Receiving objects: 31% (602/1941) Receiving objects: 32% (622/1941) Receiving objects: 33% (641/1941) Receiving objects: 34% (660/1941) Receiving objects: 35% (680/1941) Receiving objects: 36% (699/1941) Receiving objects: 37% (719/1941) Receiving objects: 38% (738/1941) Receiving objects: 39% (757/1941) Receiving objects: 40% (777/1941) Receiving objects: 41% (796/1941) Receiving objects: 42% (816/1941) Receiving objects: 43% (835/1941) Receiving objects: 44% (855/1941) Receiving objects: 45% (874/1941) Receiving objects: 46% (893/1941) Receiving objects: 47% (913/1941) Receiving objects: 48% (932/1941) Receiving objects: 49% (952/1941) Receiving objects: 50% (971/1941) Receiving objects: 51% (990/1941) Receiving objects: 52% (1010/1941) Receiving objects: 53% (1029/1941) Receiving objects: 54% (1049/1941) Receiving objects: 55% (1068/1941) Receiving objects: 56% (1087/1941) Receiving objects: 57% (1107/1941) Receiving objects: 58% (1126/1941) Receiving objects: 59% (1146/1941) Receiving objects: 60% (1165/1941) Receiving objects: 61% (1185/1941) Receiving objects: 62% (1204/1941) Receiving objects: 63% (1223/1941) Receiving objects: 64% (1243/1941) Receiving objects: 65% (1262/1941) Receiving objects: 66% (1282/1941) Receiving objects: 67% (1301/1941) Receiving objects: 68% (1320/1941) Receiving objects: 69% (1340/1941) Receiving objects: 70% (1359/1941) Receiving objects: 71% (1379/1941) Receiving objects: 72% (1398/1941) Receiving objects: 73% (1417/1941) Receiving objects: 74% (1437/1941) Receiving objects: 75% (1456/1941) Receiving objects: 76% (1476/1941) Receiving objects: 77% (1495/1941) Receiving objects: 78% (1514/1941) Receiving objects: 79% (1534/1941) Receiving objects: 80% (1553/1941) Receiving objects: 81% (1573/1941) Receiving objects: 82% (1592/1941) Receiving objects: 83% (1612/1941) Receiving objects: 84% (1631/1941) Receiving objects: 85% (1650/1941) Receiving objects: 86% (1670/1941) Receiving objects: 87% (1689/1941) Receiving objects: 88% (1709/1941) Receiving objects: 89% (1728/1941) Receiving objects: 90% (1747/1941) Receiving objects: 91% (1767/1941) Receiving objects: 92% (1786/1941) Receiving objects: 93% (1806/1941) Receiving objects: 94% (1825/1941) remote: Total 1941 (delta 696), reused 632 (delta 632), pack-reused 1074
Receiving objects: 95% (1844/1941) Receiving objects: 96% (1864/1941) Receiving objects: 97% (1883/1941) Receiving objects: 98% (1903/1941) Receiving objects: 99% (1922/1941) Receiving objects: 100% (1941/1941) Receiving objects: 100% (1941/1941), 257.33 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/719) Resolving deltas: 1% (8/719) Resolving deltas: 2% (15/719) Resolving deltas: 3% (22/719) Resolving deltas: 4% (31/719) Resolving deltas: 5% (41/719) Resolving deltas: 6% (47/719) Resolving deltas: 7% (52/719) Resolving deltas: 8% (59/719) Resolving deltas: 9% (70/719) Resolving deltas: 10% (79/719) Resolving deltas: 11% (80/719) Resolving deltas: 12% (87/719) Resolving deltas: 13% (94/719) Resolving deltas: 15% (108/719) Resolving deltas: 16% (119/719) Resolving deltas: 17% (124/719) Resolving deltas: 19% (142/719) Resolving deltas: 20% (145/719) Resolving deltas: 21% (156/719) Resolving deltas: 22% (162/719) Resolving deltas: 23% (166/719) Resolving deltas: 24% (173/719) Resolving deltas: 25% (180/719) Resolving deltas: 26% (187/719) Resolving deltas: 27% (195/719) Resolving deltas: 28% (203/719) Resolving deltas: 29% (210/719) Resolving deltas: 30% (218/719) Resolving deltas: 31% (223/719) Resolving deltas: 32% (231/719) Resolving deltas: 33% (238/719) Resolving deltas: 34% (246/719) Resolving deltas: 35% (252/719) Resolving deltas: 36% (259/719) Resolving deltas: 37% (268/719) Resolving deltas: 38% (274/719) Resolving deltas: 39% (282/719) Resolving deltas: 40% (288/719) Resolving deltas: 41% (296/719) Resolving deltas: 42% (303/719) Resolving deltas: 43% (310/719) Resolving deltas: 44% (317/719) Resolving deltas: 45% (325/719) Resolving deltas: 46% (335/719) Resolving deltas: 47% (338/719) Resolving deltas: 48% (346/719) Resolving deltas: 49% (355/719) Resolving deltas: 50% (360/719) Resolving deltas: 51% (369/719) Resolving deltas: 52% (379/719) Resolving deltas: 53% (383/719) Resolving deltas: 54% (390/719) Resolving deltas: 55% (396/719) Resolving deltas: 56% (403/719) Resolving deltas: 57% (412/719) Resolving deltas: 58% (419/719) Resolving deltas: 59% (425/719) Resolving deltas: 60% (432/719) Resolving deltas: 61% (439/719) Resolving deltas: 62% (447/719) Resolving deltas: 63% (454/719) Resolving deltas: 64% (462/719) Resolving deltas: 65% (470/719) Resolving deltas: 66% (478/719) Resolving deltas: 67% (482/719) Resolving deltas: 68% (490/719) Resolving deltas: 69% (498/719) Resolving deltas: 70% (505/719) Resolving deltas: 71% (511/719) Resolving deltas: 72% (519/719) Resolving deltas: 73% (526/719) Resolving deltas: 74% (533/719) Resolving deltas: 75% (541/719) Resolving deltas: 76% (548/719) Resolving deltas: 77% (555/719) Resolving deltas: 78% (562/719) Resolving deltas: 79% (570/719) Resolving deltas: 80% (576/719) Resolving deltas: 81% (584/719) Resolving deltas: 82% (590/719) Resolving deltas: 83% (598/719) Resolving deltas: 84% (604/719) Resolving deltas: 85% (612/719) Resolving deltas: 86% (619/719) Resolving deltas: 87% (626/719) Resolving deltas: 88% (633/719) Resolving deltas: 89% (640/719) Resolving deltas: 90% (648/719) Resolving deltas: 91% (655/719) Resolving deltas: 92% (662/719) Resolving deltas: 94% (677/719) Resolving deltas: 95% (684/719) Resolving deltas: 96% (693/719) Resolving deltas: 97% (698/719) Resolving deltas: 98% (706/719) Resolving deltas: 99% (713/719) Resolving deltas: 100% (719/719) Resolving deltas: 100% (719/719), completed with 295 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2457/head: No such file or directory
! 2b57dbf...6da2026 refs/pull/2457/head -> origin/pr/2457/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! c1f2a0c...d158c14 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3073561050663803706.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5106164085112923022.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3489441953458436907.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3948071831209831805.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 06:02:50,510 21cf9cc3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/21cf9cc3/pkb.log
2017-04-16 06:02:50,510 21cf9cc3 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 06:02:50,511 21cf9cc3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 06:02:50,771 21cf9cc3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 06:02:50,861 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 06:02:50,863 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 06:02:50,864 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 06:02:50,870 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 06:02:50,872 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 06:02:50,894 21cf9cc3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 06:02:50,894 21cf9cc3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/21cf9cc3/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #313
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/313/display/redirect>
------------------------------------------
[...truncated 236.42 KB...]
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1959, done.
remote: Compressing objects: 0% (1/162) remote: Compressing objects: 1% (2/162) remote: Compressing objects: 2% (4/162) remote: Compressing objects: 3% (5/162) remote: Compressing objects: 4% (7/162) remote: Compressing objects: 5% (9/162) remote: Compressing objects: 6% (10/162) remote: Compressing objects: 7% (12/162) remote: Compressing objects: 8% (13/162) remote: Compressing objects: 9% (15/162) remote: Compressing objects: 10% (17/162) remote: Compressing objects: 11% (18/162) remote: Compressing objects: 12% (20/162) remote: Compressing objects: 13% (22/162) remote: Compressing objects: 14% (23/162) remote: Compressing objects: 15% (25/162) remote: Compressing objects: 16% (26/162) remote: Compressing objects: 17% (28/162) remote: Compressing objects: 18% (30/162) remote: Compressing objects: 19% (31/162) remote: Compressing objects: 20% (33/162) remote: Compressing objects: 21% (35/162) remote: Compressing objects: 22% (36/162) remote: Compressing objects: 23% (38/162) remote: Compressing objects: 24% (39/162) remote: Compressing objects: 25% (41/162) remote: Compressing objects: 26% (43/162) remote: Compressing objects: 27% (44/162) remote: Compressing objects: 28% (46/162) remote: Compressing objects: 29% (47/162) remote: Compressing objects: 30% (49/162) remote: Compressing objects: 31% (51/162) remote: Compressing objects: 32% (52/162) remote: Compressing objects: 33% (54/162) remote: Compressing objects: 34% (56/162) remote: Compressing objects: 35% (57/162) remote: Compressing objects: 36% (59/162) remote: Compressing objects: 37% (60/162) remote: Compressing objects: 38% (62/162) remote: Compressing objects: 39% (64/162) remote: Compressing objects: 40% (65/162) remote: Compressing objects: 41% (67/162) remote: Compressing objects: 42% (69/162) remote: Compressing objects: 43% (70/162) remote: Compressing objects: 44% (72/162) remote: Compressing objects: 45% (73/162) remote: Compressing objects: 46% (75/162) remote: Compressing objects: 47% (77/162) remote: Compressing objects: 48% (78/162) remote: Compressing objects: 49% (80/162) remote: Compressing objects: 50% (81/162) remote: Compressing objects: 51% (83/162) remote: Compressing objects: 52% (85/162) remote: Compressing objects: 53% (86/162) remote: Compressing objects: 54% (88/162) remote: Compressing objects: 55% (90/162) remote: Compressing objects: 56% (91/162) remote: Compressing objects: 57% (93/162) remote: Compressing objects: 58% (94/162) remote: Compressing objects: 59% (96/162) remote: Compressing objects: 60% (98/162) remote: Compressing objects: 61% (99/162) remote: Compressing objects: 62% (101/162) remote: Compressing objects: 63% (103/162) remote: Compressing objects: 64% (104/162) remote: Compressing objects: 65% (106/162) remote: Compressing objects: 66% (107/162) remote: Compressing objects: 67% (109/162) remote: Compressing objects: 68% (111/162) remote: Compressing objects: 69% (112/162) remote: Compressing objects: 70% (114/162) remote: Compressing objects: 71% (116/162) remote: Compressing objects: 72% (117/162) remote: Compressing objects: 73% (119/162) remote: Compressing objects: 74% (120/162) remote: Compressing objects: 75% (122/162) remote: Compressing objects: 76% (124/162) remote: Compressing objects: 77% (125/162) remote: Compressing objects: 78% (127/162) remote: Compressing objects: 79% (128/162) remote: Compressing objects: 80% (130/162) remote: Compressing objects: 81% (132/162) remote: Compressing objects: 82% (133/162) remote: Compressing objects: 83% (135/162) remote: Compressing objects: 84% (137/162) remote: Compressing objects: 85% (138/162) remote: Compressing objects: 86% (140/162) remote: Compressing objects: 87% (141/162) remote: Compressing objects: 88% (143/162) remote: Compressing objects: 89% (145/162) remote: Compressing objects: 90% (146/162) remote: Compressing objects: 91% (148/162) remote: Compressing objects: 92% (150/162) remote: Compressing objects: 93% (151/162) remote: Compressing objects: 94% (153/162) remote: Compressing objects: 95% (154/162) remote: Compressing objects: 96% (156/162) remote: Compressing objects: 97% (158/162) remote: Compressing objects: 98% (159/162) remote: Compressing objects: 99% (161/162) remote: Compressing objects: 100% (162/162) remote: Compressing objects: 100% (162/162), done.
Receiving objects: 0% (1/1959) Receiving objects: 1% (20/1959) Receiving objects: 2% (40/1959) Receiving objects: 3% (59/1959) Receiving objects: 4% (79/1959) Receiving objects: 5% (98/1959) Receiving objects: 6% (118/1959) Receiving objects: 7% (138/1959) Receiving objects: 8% (157/1959) Receiving objects: 9% (177/1959) Receiving objects: 10% (196/1959) Receiving objects: 11% (216/1959) Receiving objects: 12% (236/1959) Receiving objects: 13% (255/1959) Receiving objects: 14% (275/1959) Receiving objects: 15% (294/1959) Receiving objects: 16% (314/1959) Receiving objects: 17% (334/1959) Receiving objects: 18% (353/1959) Receiving objects: 19% (373/1959) Receiving objects: 20% (392/1959) Receiving objects: 21% (412/1959) Receiving objects: 22% (431/1959) Receiving objects: 23% (451/1959) Receiving objects: 24% (471/1959) Receiving objects: 25% (490/1959) Receiving objects: 26% (510/1959) Receiving objects: 27% (529/1959) Receiving objects: 28% (549/1959) Receiving objects: 29% (569/1959) Receiving objects: 30% (588/1959) Receiving objects: 31% (608/1959) Receiving objects: 32% (627/1959) Receiving objects: 33% (647/1959) Receiving objects: 34% (667/1959) Receiving objects: 35% (686/1959) Receiving objects: 36% (706/1959) Receiving objects: 37% (725/1959) Receiving objects: 38% (745/1959) Receiving objects: 39% (765/1959) Receiving objects: 40% (784/1959) Receiving objects: 41% (804/1959) Receiving objects: 42% (823/1959) Receiving objects: 43% (843/1959) Receiving objects: 44% (862/1959) Receiving objects: 45% (882/1959) Receiving objects: 46% (902/1959) Receiving objects: 47% (921/1959) Receiving objects: 48% (941/1959) Receiving objects: 49% (960/1959) Receiving objects: 50% (980/1959) Receiving objects: 51% (1000/1959) Receiving objects: 52% (1019/1959) Receiving objects: 53% (1039/1959) Receiving objects: 54% (1058/1959) Receiving objects: 55% (1078/1959) Receiving objects: 56% (1098/1959) Receiving objects: 57% (1117/1959) Receiving objects: 58% (1137/1959) Receiving objects: 59% (1156/1959) Receiving objects: 60% (1176/1959) Receiving objects: 61% (1195/1959) Receiving objects: 62% (1215/1959) Receiving objects: 63% (1235/1959) Receiving objects: 64% (1254/1959) Receiving objects: 65% (1274/1959) Receiving objects: 66% (1293/1959) Receiving objects: 67% (1313/1959) Receiving objects: 68% (1333/1959) Receiving objects: 69% (1352/1959) Receiving objects: 70% (1372/1959) Receiving objects: 71% (1391/1959) Receiving objects: 72% (1411/1959) Receiving objects: 73% (1431/1959) Receiving objects: 74% (1450/1959) Receiving objects: 75% (1470/1959) Receiving objects: 76% (1489/1959) Receiving objects: 77% (1509/1959) Receiving objects: 78% (1529/1959) Receiving objects: 79% (1548/1959) Receiving objects: 80% (1568/1959) Receiving objects: 81% (1587/1959) Receiving objects: 82% (1607/1959) Receiving objects: 83% (1626/1959) Receiving objects: 84% (1646/1959) Receiving objects: 85% (1666/1959) Receiving objects: 86% (1685/1959) Receiving objects: 87% (1705/1959) Receiving objects: 88% (1724/1959) Receiving objects: 89% (1744/1959) Receiving objects: 90% (1764/1959) Receiving objects: 91% (1783/1959) remote: Total 1959 (delta 701), reused 634 (delta 634), pack-reused 1087
Receiving objects: 92% (1803/1959) Receiving objects: 93% (1822/1959) Receiving objects: 94% (1842/1959) Receiving objects: 95% (1862/1959) Receiving objects: 96% (1881/1959) Receiving objects: 97% (1901/1959) Receiving objects: 98% (1920/1959) Receiving objects: 99% (1940/1959) Receiving objects: 100% (1959/1959) Receiving objects: 100% (1959/1959), 258.36 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/724) Resolving deltas: 1% (8/724) Resolving deltas: 2% (15/724) Resolving deltas: 3% (22/724) Resolving deltas: 4% (29/724) Resolving deltas: 5% (37/724) Resolving deltas: 6% (47/724) Resolving deltas: 7% (53/724) Resolving deltas: 8% (58/724) Resolving deltas: 9% (68/724) Resolving deltas: 10% (74/724) Resolving deltas: 11% (82/724) Resolving deltas: 12% (87/724) Resolving deltas: 13% (98/724) Resolving deltas: 15% (112/724) Resolving deltas: 16% (118/724) Resolving deltas: 17% (128/724) Resolving deltas: 20% (146/724) Resolving deltas: 21% (153/724) Resolving deltas: 22% (160/724) Resolving deltas: 23% (167/724) Resolving deltas: 24% (175/724) Resolving deltas: 25% (181/724) Resolving deltas: 26% (189/724) Resolving deltas: 27% (197/724) Resolving deltas: 28% (203/724) Resolving deltas: 29% (210/724) Resolving deltas: 30% (219/724) Resolving deltas: 31% (225/724) Resolving deltas: 32% (233/724) Resolving deltas: 33% (242/724) Resolving deltas: 34% (250/724) Resolving deltas: 35% (256/724) Resolving deltas: 36% (261/724) Resolving deltas: 37% (269/724) Resolving deltas: 38% (278/724) Resolving deltas: 39% (286/724) Resolving deltas: 40% (292/724) Resolving deltas: 41% (298/724) Resolving deltas: 42% (305/724) Resolving deltas: 43% (314/724) Resolving deltas: 44% (319/724) Resolving deltas: 45% (327/724) Resolving deltas: 46% (339/724) Resolving deltas: 47% (342/724) Resolving deltas: 48% (348/724) Resolving deltas: 49% (359/724) Resolving deltas: 50% (362/724) Resolving deltas: 51% (370/724) Resolving deltas: 52% (377/724) Resolving deltas: 53% (384/724) Resolving deltas: 54% (391/724) Resolving deltas: 55% (400/724) Resolving deltas: 56% (406/724) Resolving deltas: 57% (416/724) Resolving deltas: 58% (421/724) Resolving deltas: 59% (428/724) Resolving deltas: 60% (435/724) Resolving deltas: 61% (442/724) Resolving deltas: 62% (449/724) Resolving deltas: 63% (457/724) Resolving deltas: 64% (465/724) Resolving deltas: 65% (473/724) Resolving deltas: 66% (481/724) Resolving deltas: 67% (489/724) Resolving deltas: 68% (493/724) Resolving deltas: 69% (501/724) Resolving deltas: 70% (508/724) Resolving deltas: 71% (516/724) Resolving deltas: 72% (522/724) Resolving deltas: 73% (529/724) Resolving deltas: 74% (536/724) Resolving deltas: 75% (544/724) Resolving deltas: 76% (551/724) Resolving deltas: 77% (558/724) Resolving deltas: 78% (565/724) Resolving deltas: 79% (573/724) Resolving deltas: 80% (581/724) Resolving deltas: 81% (587/724) Resolving deltas: 82% (594/724) Resolving deltas: 83% (601/724) Resolving deltas: 84% (610/724) Resolving deltas: 85% (616/724) Resolving deltas: 86% (623/724) Resolving deltas: 87% (630/724) Resolving deltas: 88% (639/724) Resolving deltas: 89% (645/724) Resolving deltas: 90% (652/724) Resolving deltas: 91% (659/724) Resolving deltas: 92% (667/724) Resolving deltas: 93% (680/724) Resolving deltas: 94% (682/724) Resolving deltas: 95% (688/724) Resolving deltas: 96% (696/724) Resolving deltas: 97% (704/724) Resolving deltas: 98% (710/724) Resolving deltas: 99% (717/724) Resolving deltas: 100% (724/724) Resolving deltas: 100% (724/724), completed with 299 local objects.
error: unable to resolve reference refs/remotes/origin/pr/1904/merge: No such file or directory
! 4d35f04...82f9665 refs/pull/1904/merge -> origin/pr/1904/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1905/merge: No such file or directory
! 0293686...f60b113 refs/pull/1905/merge -> origin/pr/1905/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2146/merge: No such file or directory
! db88f4f...2899397 refs/pull/2146/merge -> origin/pr/2146/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2294/merge: No such file or directory
! 316c95d...649443f refs/pull/2294/merge -> origin/pr/2294/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2351/merge: No such file or directory
! c052529...19af537 refs/pull/2351/merge -> origin/pr/2351/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2375/merge: No such file or directory
! 6b2cff9...75addeb refs/pull/2375/merge -> origin/pr/2375/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8127513786137412581.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3725894120399473020.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8242639319447963272.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4632952067081403753.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 00:02:29,141 987f663c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/987f663c/pkb.log
2017-04-16 00:02:29,141 987f663c MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 00:02:29,142 987f663c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 00:02:29,376 987f663c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 00:02:29,461 987f663c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 00:02:29,463 987f663c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 00:02:29,464 987f663c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 00:02:29,469 987f663c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 00:02:29,471 987f663c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 00:02:29,496 987f663c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 00:02:29,497 987f663c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/987f663c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #312
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/312/display/redirect>
------------------------------------------
[...truncated 236.00 KB...]
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1921, done.
remote: Compressing objects: 0% (1/133) remote: Compressing objects: 1% (2/133) remote: Compressing objects: 2% (3/133) remote: Compressing objects: 3% (4/133) remote: Compressing objects: 4% (6/133) remote: Compressing objects: 5% (7/133) remote: Compressing objects: 6% (8/133) remote: Compressing objects: 7% (10/133) remote: Compressing objects: 8% (11/133) remote: Compressing objects: 9% (12/133) remote: Compressing objects: 10% (14/133) remote: Compressing objects: 11% (15/133) remote: Compressing objects: 12% (16/133) remote: Compressing objects: 13% (18/133) remote: Compressing objects: 14% (19/133) remote: Compressing objects: 15% (20/133) remote: Compressing objects: 16% (22/133) remote: Compressing objects: 17% (23/133) remote: Compressing objects: 18% (24/133) remote: Compressing objects: 19% (26/133) remote: Compressing objects: 20% (27/133) remote: Compressing objects: 21% (28/133) remote: Compressing objects: 22% (30/133) remote: Compressing objects: 23% (31/133) remote: Compressing objects: 24% (32/133) remote: Compressing objects: 25% (34/133) remote: Compressing objects: 26% (35/133) remote: Compressing objects: 27% (36/133) remote: Compressing objects: 28% (38/133) remote: Compressing objects: 29% (39/133) remote: Compressing objects: 30% (40/133) remote: Compressing objects: 31% (42/133) remote: Compressing objects: 32% (43/133) remote: Compressing objects: 33% (44/133) remote: Compressing objects: 34% (46/133) remote: Compressing objects: 35% (47/133) remote: Compressing objects: 36% (48/133) remote: Compressing objects: 37% (50/133) remote: Compressing objects: 38% (51/133) remote: Compressing objects: 39% (52/133) remote: Compressing objects: 40% (54/133) remote: Compressing objects: 41% (55/133) remote: Compressing objects: 42% (56/133) remote: Compressing objects: 43% (58/133) remote: Compressing objects: 44% (59/133) remote: Compressing objects: 45% (60/133) remote: Compressing objects: 46% (62/133) remote: Compressing objects: 47% (63/133) remote: Compressing objects: 48% (64/133) remote: Compressing objects: 49% (66/133) remote: Compressing objects: 50% (67/133) remote: Compressing objects: 51% (68/133) remote: Compressing objects: 52% (70/133) remote: Compressing objects: 53% (71/133) remote: Compressing objects: 54% (72/133) remote: Compressing objects: 55% (74/133) remote: Compressing objects: 56% (75/133) remote: Compressing objects: 57% (76/133) remote: Compressing objects: 58% (78/133) remote: Compressing objects: 59% (79/133) remote: Compressing objects: 60% (80/133) remote: Compressing objects: 61% (82/133) remote: Compressing objects: 62% (83/133) remote: Compressing objects: 63% (84/133) remote: Compressing objects: 64% (86/133) remote: Compressing objects: 65% (87/133) remote: Compressing objects: 66% (88/133) remote: Compressing objects: 67% (90/133) remote: Compressing objects: 68% (91/133) remote: Compressing objects: 69% (92/133) remote: Compressing objects: 70% (94/133) remote: Compressing objects: 71% (95/133) remote: Compressing objects: 72% (96/133) remote: Compressing objects: 73% (98/133) remote: Compressing objects: 74% (99/133) remote: Compressing objects: 75% (100/133) remote: Compressing objects: 76% (102/133) remote: Compressing objects: 77% (103/133) remote: Compressing objects: 78% (104/133) remote: Compressing objects: 79% (106/133) remote: Compressing objects: 80% (107/133) remote: Compressing objects: 81% (108/133) remote: Compressing objects: 82% (110/133) remote: Compressing objects: 83% (111/133) remote: Compressing objects: 84% (112/133) remote: Compressing objects: 85% (114/133) remote: Compressing objects: 86% (115/133) remote: Compressing objects: 87% (116/133) remote: Compressing objects: 88% (118/133) remote: Compressing objects: 89% (119/133) remote: Compressing objects: 90% (120/133) remote: Compressing objects: 91% (122/133) remote: Compressing objects: 92% (123/133) remote: Compressing objects: 93% (124/133) remote: Compressing objects: 94% (126/133) remote: Compressing objects: 95% (127/133) remote: Compressing objects: 96% (128/133) remote: Compressing objects: 97% (130/133) remote: Compressing objects: 98% (131/133) remote: Compressing objects: 99% (132/133) remote: Compressing objects: 100% (133/133) remote: Compressing objects: 100% (133/133), done.
Receiving objects: 0% (1/1921) Receiving objects: 1% (20/1921) Receiving objects: 2% (39/1921) Receiving objects: 3% (58/1921) Receiving objects: 4% (77/1921) Receiving objects: 5% (97/1921) Receiving objects: 6% (116/1921) Receiving objects: 7% (135/1921) Receiving objects: 8% (154/1921) Receiving objects: 9% (173/1921) Receiving objects: 10% (193/1921) Receiving objects: 11% (212/1921) Receiving objects: 12% (231/1921) Receiving objects: 13% (250/1921) Receiving objects: 14% (269/1921) Receiving objects: 15% (289/1921) Receiving objects: 16% (308/1921) Receiving objects: 17% (327/1921) Receiving objects: 18% (346/1921) Receiving objects: 19% (365/1921) Receiving objects: 20% (385/1921) Receiving objects: 21% (404/1921) Receiving objects: 22% (423/1921) Receiving objects: 23% (442/1921) Receiving objects: 24% (462/1921) Receiving objects: 25% (481/1921) Receiving objects: 26% (500/1921) Receiving objects: 27% (519/1921) Receiving objects: 28% (538/1921) Receiving objects: 29% (558/1921) Receiving objects: 30% (577/1921) Receiving objects: 31% (596/1921) Receiving objects: 32% (615/1921) Receiving objects: 33% (634/1921) Receiving objects: 34% (654/1921) Receiving objects: 35% (673/1921) Receiving objects: 36% (692/1921) Receiving objects: 37% (711/1921) Receiving objects: 38% (730/1921) Receiving objects: 39% (750/1921) Receiving objects: 40% (769/1921) Receiving objects: 41% (788/1921) Receiving objects: 42% (807/1921) Receiving objects: 43% (827/1921) Receiving objects: 44% (846/1921) Receiving objects: 45% (865/1921) Receiving objects: 46% (884/1921) Receiving objects: 47% (903/1921) Receiving objects: 48% (923/1921) Receiving objects: 49% (942/1921) Receiving objects: 50% (961/1921) Receiving objects: 51% (980/1921) Receiving objects: 52% (999/1921) Receiving objects: 53% (1019/1921) Receiving objects: 54% (1038/1921) Receiving objects: 55% (1057/1921) Receiving objects: 56% (1076/1921) Receiving objects: 57% (1095/1921) Receiving objects: 58% (1115/1921) Receiving objects: 59% (1134/1921) Receiving objects: 60% (1153/1921) Receiving objects: 61% (1172/1921) Receiving objects: 62% (1192/1921) Receiving objects: 63% (1211/1921) Receiving objects: 64% (1230/1921) Receiving objects: 65% (1249/1921) Receiving objects: 66% (1268/1921) Receiving objects: 67% (1288/1921) Receiving objects: 68% (1307/1921) Receiving objects: 69% (1326/1921) Receiving objects: 70% (1345/1921) Receiving objects: 71% (1364/1921) Receiving objects: 72% (1384/1921) Receiving objects: 73% (1403/1921) Receiving objects: 74% (1422/1921) Receiving objects: 75% (1441/1921) Receiving objects: 76% (1460/1921) Receiving objects: 77% (1480/1921) Receiving objects: 78% (1499/1921) Receiving objects: 79% (1518/1921) Receiving objects: 80% (1537/1921) Receiving objects: 81% (1557/1921) Receiving objects: 82% (1576/1921) Receiving objects: 83% (1595/1921) Receiving objects: 84% (1614/1921) Receiving objects: 85% (1633/1921) Receiving objects: 86% (1653/1921) Receiving objects: 87% (1672/1921) remote: Total 1921 (delta 690), reused 636 (delta 636), pack-reused 1084
Receiving objects: 88% (1691/1921) Receiving objects: 89% (1710/1921) Receiving objects: 90% (1729/1921) Receiving objects: 91% (1749/1921) Receiving objects: 92% (1768/1921) Receiving objects: 93% (1787/1921) Receiving objects: 94% (1806/1921) Receiving objects: 95% (1825/1921) Receiving objects: 96% (1845/1921) Receiving objects: 97% (1864/1921) Receiving objects: 98% (1883/1921) Receiving objects: 99% (1902/1921) Receiving objects: 100% (1921/1921) Receiving objects: 100% (1921/1921), 250.48 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/713) Resolving deltas: 1% (8/713) Resolving deltas: 2% (15/713) Resolving deltas: 3% (22/713) Resolving deltas: 4% (30/713) Resolving deltas: 5% (36/713) Resolving deltas: 6% (44/713) Resolving deltas: 7% (56/713) Resolving deltas: 8% (62/713) Resolving deltas: 9% (69/713) Resolving deltas: 10% (72/713) Resolving deltas: 11% (84/713) Resolving deltas: 12% (87/713) Resolving deltas: 14% (100/713) Resolving deltas: 15% (108/713) Resolving deltas: 16% (120/713) Resolving deltas: 17% (125/713) Resolving deltas: 18% (130/713) Resolving deltas: 20% (149/713) Resolving deltas: 21% (152/713) Resolving deltas: 22% (157/713) Resolving deltas: 23% (164/713) Resolving deltas: 24% (173/713) Resolving deltas: 25% (179/713) Resolving deltas: 26% (187/713) Resolving deltas: 27% (195/713) Resolving deltas: 28% (201/713) Resolving deltas: 29% (208/713) Resolving deltas: 30% (214/713) Resolving deltas: 31% (223/713) Resolving deltas: 32% (229/713) Resolving deltas: 33% (238/713) Resolving deltas: 34% (246/713) Resolving deltas: 35% (252/713) Resolving deltas: 36% (257/713) Resolving deltas: 37% (265/713) Resolving deltas: 38% (274/713) Resolving deltas: 39% (283/713) Resolving deltas: 40% (289/713) Resolving deltas: 41% (293/713) Resolving deltas: 42% (300/713) Resolving deltas: 43% (310/713) Resolving deltas: 44% (315/713) Resolving deltas: 45% (323/713) Resolving deltas: 46% (328/713) Resolving deltas: 47% (336/713) Resolving deltas: 48% (343/713) Resolving deltas: 49% (355/713) Resolving deltas: 50% (357/713) Resolving deltas: 51% (364/713) Resolving deltas: 52% (373/713) Resolving deltas: 53% (379/713) Resolving deltas: 54% (386/713) Resolving deltas: 55% (396/713) Resolving deltas: 56% (401/713) Resolving deltas: 57% (407/713) Resolving deltas: 58% (414/713) Resolving deltas: 59% (421/713) Resolving deltas: 60% (430/713) Resolving deltas: 61% (435/713) Resolving deltas: 62% (444/713) Resolving deltas: 63% (450/713) Resolving deltas: 64% (458/713) Resolving deltas: 65% (466/713) Resolving deltas: 66% (474/713) Resolving deltas: 67% (478/713) Resolving deltas: 68% (486/713) Resolving deltas: 69% (492/713) Resolving deltas: 70% (501/713) Resolving deltas: 71% (507/713) Resolving deltas: 72% (515/713) Resolving deltas: 73% (522/713) Resolving deltas: 74% (529/713) Resolving deltas: 75% (537/713) Resolving deltas: 76% (542/713) Resolving deltas: 77% (551/713) Resolving deltas: 78% (558/713) Resolving deltas: 79% (564/713) Resolving deltas: 80% (572/713) Resolving deltas: 81% (578/713) Resolving deltas: 82% (585/713) Resolving deltas: 83% (592/713) Resolving deltas: 84% (599/713) Resolving deltas: 85% (607/713) Resolving deltas: 86% (614/713) Resolving deltas: 87% (621/713) Resolving deltas: 88% (628/713) Resolving deltas: 89% (635/713) Resolving deltas: 90% (642/713) Resolving deltas: 91% (649/713) Resolving deltas: 92% (656/713) Resolving deltas: 94% (671/713) Resolving deltas: 95% (678/713) Resolving deltas: 96% (687/713) Resolving deltas: 97% (692/713) Resolving deltas: 98% (700/713) Resolving deltas: 99% (707/713) Resolving deltas: 100% (713/713) Resolving deltas: 100% (713/713), completed with 291 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2508/head: No such file or directory
! 66546ec...3ab7e0d refs/pull/2508/head -> origin/pr/2508/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 927fcfd...0f89790 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5980049308857655223.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2411134862328243663.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5444168747191397803.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6739736370980007338.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-15 18:02:55,082 a288b19e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/a288b19e/pkb.log
2017-04-15 18:02:55,083 a288b19e MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-15 18:02:55,083 a288b19e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-15 18:02:55,238 a288b19e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-15 18:02:55,333 a288b19e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-15 18:02:55,336 a288b19e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-15 18:02:55,337 a288b19e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-15 18:02:55,343 a288b19e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-15 18:02:55,345 a288b19e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-15 18:02:55,364 a288b19e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-15 18:02:55,365 a288b19e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/a288b19e/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #311
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/311/display/redirect?page=changes>
Changes:
[kirpichov] [BEAM-1915] Removes use of OldDoFn from Apex
[kirpichov] Removes final minor usages of OldDoFn outside OldDoFn itself
------------------------------------------
[...truncated 239.29 KB...]
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 4116, done.
remote: Compressing objects: 0% (1/265) remote: Compressing objects: 1% (3/265) remote: Compressing objects: 2% (6/265) remote: Compressing objects: 3% (8/265) remote: Compressing objects: 4% (11/265) remote: Compressing objects: 5% (14/265) remote: Compressing objects: 6% (16/265) remote: Compressing objects: 7% (19/265) remote: Compressing objects: 8% (22/265) remote: Compressing objects: 9% (24/265) remote: Compressing objects: 10% (27/265) remote: Compressing objects: 11% (30/265) remote: Compressing objects: 12% (32/265) remote: Compressing objects: 13% (35/265) remote: Compressing objects: 14% (38/265) remote: Compressing objects: 15% (40/265) remote: Compressing objects: 16% (43/265) remote: Compressing objects: 17% (46/265) remote: Compressing objects: 18% (48/265) remote: Compressing objects: 19% (51/265) remote: Compressing objects: 20% (53/265) remote: Compressing objects: 21% (56/265) remote: Compressing objects: 22% (59/265) remote: Compressing objects: 23% (61/265) remote: Compressing objects: 24% (64/265) remote: Compressing objects: 25% (67/265) remote: Compressing objects: 26% (69/265) remote: Compressing objects: 27% (72/265) remote: Compressing objects: 28% (75/265) remote: Compressing objects: 29% (77/265) remote: Compressing objects: 30% (80/265) remote: Compressing objects: 31% (83/265) remote: Compressing objects: 32% (85/265) remote: Compressing objects: 33% (88/265) remote: Compressing objects: 34% (91/265) remote: Compressing objects: 35% (93/265) remote: Compressing objects: 36% (96/265) remote: Compressing objects: 37% (99/265) remote: Compressing objects: 38% (101/265) remote: Compressing objects: 39% (104/265) remote: Compressing objects: 40% (106/265) remote: Compressing objects: 41% (109/265) remote: Compressing objects: 42% (112/265) remote: Compressing objects: 43% (114/265) remote: Compressing objects: 44% (117/265) remote: Compressing objects: 45% (120/265) remote: Compressing objects: 46% (122/265) remote: Compressing objects: 47% (125/265) remote: Compressing objects: 48% (128/265) remote: Compressing objects: 49% (130/265) remote: Compressing objects: 50% (133/265) remote: Compressing objects: 51% (136/265) remote: Compressing objects: 52% (138/265) remote: Compressing objects: 53% (141/265) remote: Compressing objects: 54% (144/265) remote: Compressing objects: 55% (146/265) remote: Compressing objects: 56% (149/265) remote: Compressing objects: 57% (152/265) remote: Compressing objects: 58% (154/265) remote: Compressing objects: 59% (157/265) remote: Compressing objects: 60% (159/265) remote: Compressing objects: 61% (162/265) remote: Compressing objects: 62% (165/265) remote: Compressing objects: 63% (167/265) remote: Compressing objects: 64% (170/265) remote: Compressing objects: 65% (173/265) remote: Compressing objects: 66% (175/265) remote: Compressing objects: 67% (178/265) remote: Compressing objects: 68% (181/265) remote: Compressing objects: 69% (183/265) remote: Compressing objects: 70% (186/265) remote: Compressing objects: 71% (189/265) remote: Compressing objects: 72% (191/265) remote: Compressing objects: 73% (194/265) remote: Compressing objects: 74% (197/265) remote: Compressing objects: 75% (199/265) remote: Compressing objects: 76% (202/265) remote: Compressing objects: 77% (205/265) remote: Compressing objects: 78% (207/265) remote: Compressing objects: 79% (210/265) remote: Compressing objects: 80% (212/265) remote: Compressing objects: 81% (215/265) remote: Compressing objects: 82% (218/265) remote: Compressing objects: 83% (220/265) remote: Compressing objects: 84% (223/265) remote: Compressing objects: 85% (226/265) remote: Compressing objects: 86% (228/265) remote: Compressing objects: 87% (231/265) remote: Compressing objects: 88% (234/265) remote: Compressing objects: 89% (236/265) remote: Compressing objects: 90% (239/265) remote: Compressing objects: 91% (242/265) remote: Compressing objects: 92% (244/265) remote: Compressing objects: 93% (247/265) remote: Compressing objects: 94% (250/265) remote: Compressing objects: 95% (252/265) remote: Compressing objects: 96% (255/265) remote: Compressing objects: 97% (258/265) remote: Compressing objects: 98% (260/265) remote: Compressing objects: 99% (263/265) remote: Compressing objects: 100% (265/265) remote: Compressing objects: 100% (265/265), done.
Receiving objects: 0% (1/4116) Receiving objects: 1% (42/4116) Receiving objects: 2% (83/4116) Receiving objects: 3% (124/4116) Receiving objects: 4% (165/4116) Receiving objects: 5% (206/4116) Receiving objects: 6% (247/4116) Receiving objects: 7% (289/4116) Receiving objects: 8% (330/4116) Receiving objects: 9% (371/4116) Receiving objects: 10% (412/4116) Receiving objects: 11% (453/4116) Receiving objects: 12% (494/4116) Receiving objects: 13% (536/4116) Receiving objects: 14% (577/4116) Receiving objects: 15% (618/4116) Receiving objects: 16% (659/4116) Receiving objects: 17% (700/4116) Receiving objects: 18% (741/4116) Receiving objects: 19% (783/4116) Receiving objects: 20% (824/4116) Receiving objects: 21% (865/4116) Receiving objects: 22% (906/4116) Receiving objects: 23% (947/4116) Receiving objects: 24% (988/4116) Receiving objects: 25% (1029/4116) Receiving objects: 26% (1071/4116) Receiving objects: 27% (1112/4116) Receiving objects: 28% (1153/4116) Receiving objects: 29% (1194/4116) Receiving objects: 30% (1235/4116) Receiving objects: 31% (1276/4116) Receiving objects: 32% (1318/4116) Receiving objects: 33% (1359/4116) Receiving objects: 34% (1400/4116) Receiving objects: 35% (1441/4116) Receiving objects: 36% (1482/4116) Receiving objects: 37% (1523/4116) Receiving objects: 38% (1565/4116) Receiving objects: 39% (1606/4116) Receiving objects: 40% (1647/4116) Receiving objects: 41% (1688/4116) Receiving objects: 42% (1729/4116) Receiving objects: 43% (1770/4116) Receiving objects: 44% (1812/4116) Receiving objects: 45% (1853/4116) Receiving objects: 46% (1894/4116) Receiving objects: 47% (1935/4116) Receiving objects: 48% (1976/4116) Receiving objects: 49% (2017/4116) Receiving objects: 50% (2058/4116) Receiving objects: 51% (2100/4116) Receiving objects: 52% (2141/4116) Receiving objects: 53% (2182/4116) Receiving objects: 54% (2223/4116) Receiving objects: 55% (2264/4116) Receiving objects: 56% (2305/4116) Receiving objects: 57% (2347/4116) Receiving objects: 58% (2388/4116) Receiving objects: 59% (2429/4116) Receiving objects: 60% (2470/4116) Receiving objects: 61% (2511/4116) Receiving objects: 62% (2552/4116) Receiving objects: 63% (2594/4116) Receiving objects: 64% (2635/4116) Receiving objects: 65% (2676/4116) Receiving objects: 66% (2717/4116) Receiving objects: 67% (2758/4116) Receiving objects: 68% (2799/4116) Receiving objects: 69% (2841/4116) Receiving objects: 70% (2882/4116) Receiving objects: 71% (2923/4116) Receiving objects: 72% (2964/4116) Receiving objects: 73% (3005/4116) Receiving objects: 74% (3046/4116) Receiving objects: 75% (3087/4116) Receiving objects: 76% (3129/4116) Receiving objects: 77% (3170/4116) Receiving objects: 78% (3211/4116) Receiving objects: 79% (3252/4116) Receiving objects: 80% (3293/4116) Receiving objects: 81% (3334/4116) Receiving objects: 82% (3376/4116) Receiving objects: 83% (3417/4116) Receiving objects: 84% (3458/4116) Receiving objects: 85% (3499/4116) Receiving objects: 86% (3540/4116) Receiving objects: 87% (3581/4116) Receiving objects: 88% (3623/4116) Receiving objects: 89% (3664/4116) Receiving objects: 90% (3705/4116) Receiving objects: 91% (3746/4116) Receiving objects: 92% (3787/4116) remote: Total 4116 (delta 1409), reused 1282 (delta 1282), pack-reused 2438
Receiving objects: 93% (3828/4116) Receiving objects: 94% (3870/4116) Receiving objects: 95% (3911/4116) Receiving objects: 96% (3952/4116) Receiving objects: 97% (3993/4116) Receiving objects: 98% (4034/4116) Receiving objects: 99% (4075/4116) Receiving objects: 100% (4116/4116) Receiving objects: 100% (4116/4116), 555.70 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/1515) Resolving deltas: 1% (18/1515) Resolving deltas: 2% (31/1515) Resolving deltas: 3% (46/1515) Resolving deltas: 4% (64/1515) Resolving deltas: 5% (76/1515) Resolving deltas: 6% (94/1515) Resolving deltas: 7% (108/1515) Resolving deltas: 8% (127/1515) Resolving deltas: 10% (158/1515) Resolving deltas: 11% (177/1515) Resolving deltas: 13% (199/1515) Resolving deltas: 14% (213/1515) Resolving deltas: 15% (233/1515) Resolving deltas: 17% (262/1515) Resolving deltas: 18% (284/1515) Resolving deltas: 19% (300/1515) Resolving deltas: 20% (305/1515) Resolving deltas: 21% (321/1515) Resolving deltas: 22% (336/1515) Resolving deltas: 23% (349/1515) Resolving deltas: 24% (365/1515) Resolving deltas: 25% (384/1515) Resolving deltas: 26% (396/1515) Resolving deltas: 27% (413/1515) Resolving deltas: 28% (427/1515) Resolving deltas: 29% (443/1515) Resolving deltas: 30% (458/1515) Resolving deltas: 31% (471/1515) Resolving deltas: 32% (485/1515) Resolving deltas: 33% (504/1515) Resolving deltas: 34% (519/1515) Resolving deltas: 36% (547/1515) Resolving deltas: 37% (561/1515) Resolving deltas: 38% (577/1515) Resolving deltas: 39% (594/1515) Resolving deltas: 40% (606/1515) Resolving deltas: 41% (625/1515) Resolving deltas: 42% (638/1515) Resolving deltas: 43% (663/1515) Resolving deltas: 44% (673/1515) Resolving deltas: 45% (683/1515) Resolving deltas: 46% (698/1515) Resolving deltas: 47% (724/1515) Resolving deltas: 48% (730/1515) Resolving deltas: 49% (744/1515) Resolving deltas: 50% (758/1515) Resolving deltas: 51% (778/1515) Resolving deltas: 52% (788/1515) Resolving deltas: 53% (804/1515) Resolving deltas: 54% (819/1515) Resolving deltas: 55% (837/1515) Resolving deltas: 56% (849/1515) Resolving deltas: 57% (865/1515) Resolving deltas: 58% (879/1515) Resolving deltas: 59% (894/1515) Resolving deltas: 60% (909/1515) Resolving deltas: 61% (926/1515) Resolving deltas: 62% (941/1515) Resolving deltas: 63% (955/1515) Resolving deltas: 64% (973/1515) Resolving deltas: 65% (986/1515) Resolving deltas: 66% (1001/1515) Resolving deltas: 67% (1021/1515) Resolving deltas: 68% (1039/1515) Resolving deltas: 69% (1046/1515) Resolving deltas: 70% (1073/1515) Resolving deltas: 71% (1076/1515) Resolving deltas: 72% (1091/1515) Resolving deltas: 73% (1111/1515) Resolving deltas: 74% (1122/1515) Resolving deltas: 75% (1137/1515) Resolving deltas: 76% (1152/1515) Resolving deltas: 77% (1167/1515) Resolving deltas: 78% (1186/1515) Resolving deltas: 79% (1197/1515) Resolving deltas: 80% (1212/1515) Resolving deltas: 81% (1228/1515) Resolving deltas: 82% (1244/1515) Resolving deltas: 83% (1259/1515) Resolving deltas: 84% (1273/1515) Resolving deltas: 85% (1288/1515) Resolving deltas: 86% (1304/1515) Resolving deltas: 87% (1320/1515) Resolving deltas: 88% (1335/1515) Resolving deltas: 89% (1357/1515) Resolving deltas: 90% (1364/1515) Resolving deltas: 91% (1379/1515) Resolving deltas: 92% (1395/1515) Resolving deltas: 93% (1409/1515) Resolving deltas: 94% (1428/1515) Resolving deltas: 95% (1442/1515) Resolving deltas: 96% (1455/1515) Resolving deltas: 97% (1473/1515) Resolving deltas: 98% (1489/1515) Resolving deltas: 99% (1500/1515) Resolving deltas: 100% (1515/1515) Resolving deltas: 100% (1515/1515), completed with 472 local objects.
fdbadfc..f7d727c master -> origin/master
error: unable to resolve reference refs/remotes/origin/pr/1687/merge: No such file or directory
! 6d0a5e5...ca1215f refs/pull/1687/merge -> origin/pr/1687/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1725/merge: No such file or directory
! 99b42a1...e023729 refs/pull/1725/merge -> origin/pr/1725/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1729/merge: No such file or directory
! 58d4458...ce49aad refs/pull/1729/merge -> origin/pr/1729/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1851/merge: No such file or directory
! 2b53891...78e4bf9 refs/pull/1851/merge -> origin/pr/1851/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 5a055d5...502da88 refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! 7d15c2c...b0a00bd refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! 0d2dbb8...bec8d58 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! c1f2c4f...eefcb75 refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! 65c5c1b...c53a4a4 refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! 0d1c6da...acb155f refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! a8b0b6a...1e28b4d refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 430fd9a...7f686a9 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! ff4ee2a...890d1ed refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! e35570c...36cb659 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 154eddd...b0927d5 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! cfaebbd...8524d7b refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 9e4e337...457cc80 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 921b0c7...0ec058e refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! fadc16a...557cdc4 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! a30fc3e...92f1d8c refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! d566223...ae4da02 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 3ddc654...f597223 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 39dfef6...c1f2a0c refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! f5ce38f...1eb04db refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! fa9e855...c20273c refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! f9a24c9...b1b8c98 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! d5a9e2b...10bd14d refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/head: No such file or directory
! dd963e1...a3b5f96 refs/pull/2500/head -> origin/pr/2500/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 14aff58...9cc3ca0 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 4e6f83f...927fcfd refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 1eb90fa...aed3bb9 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 5b30834...60d65b7 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list fdbadfc9cceecf645f2325777ab32f1cb3041953 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3647479131195280096.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6046535336187955417.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8788402891526215399.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4014242604697541272.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-15 12:02:49,177 c48054da MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c48054da/pkb.log
2017-04-15 12:02:49,177 c48054da MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-15 12:02:49,177 c48054da MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-15 12:02:49,364 c48054da MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-15 12:02:49,457 c48054da MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-15 12:02:49,460 c48054da MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-15 12:02:49,460 c48054da MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-15 12:02:49,466 c48054da MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-15 12:02:49,468 c48054da MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-15 12:02:49,490 c48054da MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-15 12:02:49,490 c48054da MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c48054da/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #310
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/310/display/redirect>
------------------------------------------
[...truncated 256.20 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! 28801da...1cb42dd refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 44be7cf...498d04f refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! 774167b...ebb426d refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2437/merge: No such file or directory
! 53d38b6...edde66b refs/pull/2437/merge -> origin/pr/2437/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! 1471a14...cd94a1d refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! 563729e...dc8b790 refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2441/merge: No such file or directory
! c9e7b70...3f7d1e4 refs/pull/2441/merge -> origin/pr/2441/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2444/merge: No such file or directory
! 0fa0ac3...766c268 refs/pull/2444/merge -> origin/pr/2444/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! d039def...b78575c refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2451/merge: No such file or directory
! 2556b0c...cb11bb6 refs/pull/2451/merge -> origin/pr/2451/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 6f36f19...9dca2eb refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2454/merge: No such file or directory
! ebc1fcb...9144d16 refs/pull/2454/merge -> origin/pr/2454/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! a3ea6ae...3b8ec12 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2461/merge: No such file or directory
! 7abceed...f50cc7b refs/pull/2461/merge -> origin/pr/2461/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2463/merge: No such file or directory
! d8e1697...9bbf9eb refs/pull/2463/merge -> origin/pr/2463/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2464/merge: No such file or directory
! 62d3eea...d4e537d refs/pull/2464/merge -> origin/pr/2464/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2465/merge: No such file or directory
! b4c447b...1edf2c7 refs/pull/2465/merge -> origin/pr/2465/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2467/merge: No such file or directory
! 3dc8d6b...ce16c1c refs/pull/2467/merge -> origin/pr/2467/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2472/merge: No such file or directory
! 831b2ca...10237ee refs/pull/2472/merge -> origin/pr/2472/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! 178a986...327d4bf refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2477/merge: No such file or directory
! a5f1d39...11070b5 refs/pull/2477/merge -> origin/pr/2477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2480/merge: No such file or directory
! 8ddbefe...e778720 refs/pull/2480/merge -> origin/pr/2480/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 15da1ad...6b2b994 refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! 6e5f06a...e521ab9 refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! a0d9767...e0953a7 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! 09ee9d3...6ed8545 refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2492/merge: No such file or directory
! 25853db...2a683d3 refs/pull/2492/merge -> origin/pr/2492/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! 50ea67f...a11307a refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 6831997...a9ffe52 refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! fc02db1...cb3f078 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! 3f65416...a5be5fb refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! ecf3006...29cae96 refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 0c7767e...d8b33d0 refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 658fc7a...9cc4e4d refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! b6c8397...d646411 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! 6d441b8...a51b9ed refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 8df0158...7079a6f refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 3b6ed4b...4967edf refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fdbadfc9cceecf645f2325777ab32f1cb3041953 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fdbadfc9cceecf645f2325777ab32f1cb3041953
> git rev-list fdbadfc9cceecf645f2325777ab32f1cb3041953 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson47892288458463694.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1464290744670214655.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6904416182034810045.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4180425732096873610.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-15 06:02:39,293 a5d0871f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/a5d0871f/pkb.log
2017-04-15 06:02:39,293 a5d0871f MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-15 06:02:39,294 a5d0871f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-15 06:02:39,428 a5d0871f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-15 06:02:39,526 a5d0871f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-15 06:02:39,528 a5d0871f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-15 06:02:39,529 a5d0871f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-15 06:02:39,534 a5d0871f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-15 06:02:39,536 a5d0871f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-15 06:02:39,557 a5d0871f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-15 06:02:39,558 a5d0871f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/a5d0871f/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #309
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/309/display/redirect?page=changes>
Changes:
[tgroh] Add PCollections Utilities
[dhalperi] ApexRunner: register standard IOs when deserializing pipeline options
[dhalperi] Avoi repackaging bigtable classes in dataflow runner.
[altay] [BEAM-1964] Fix lint issues for linter upgrade -2
[altay] [BEAM-1964] Fix lint issues for linter upgrade -3
[tgroh] Rename DoFn.Context#sideOutput to output
[altay] [BEAM-1964] Fix lint issues and pylint upgrade
[tgroh] Update Signature of PTransformOverrideFactory
------------------------------------------
[...truncated 261.51 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! 21442f4...774167b refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! 3d9e766...1471a14 refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! f7cf9e0...563729e refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2441/merge: No such file or directory
! ce97533...c9e7b70 refs/pull/2441/merge -> origin/pr/2441/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 9f60c28...3ddc654 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! dd3a255...d039def refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 13271e4...6f36f19 refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 1f9e3f0...a3ea6ae refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 6428fda...39dfef6 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2461/merge: No such file or directory
! 00efdeb...7abceed refs/pull/2461/merge -> origin/pr/2461/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2464/merge: No such file or directory
! e9ece7e...62d3eea refs/pull/2464/merge -> origin/pr/2464/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2465/merge: No such file or directory
! 1209746...b4c447b refs/pull/2465/merge -> origin/pr/2465/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2467/merge: No such file or directory
! 4c793da...3dc8d6b refs/pull/2467/merge -> origin/pr/2467/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! bfe9cd8...f5ce38f refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! f9610fe...fa9e855 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2480/merge: No such file or directory
! 25129aa...8ddbefe refs/pull/2480/merge -> origin/pr/2480/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 00dc4b6...f9a24c9 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 1820056...15da1ad refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! b9663eb...6e5f06a refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! bf83e88...a0d9767 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! d4e30ab...d5a9e2b refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! ee5fed4...09ee9d3 refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! 52eae97...50ea67f refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 0d0bb75...6831997 refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! d770a09...fc02db1 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! 650a5a5...91015e5 refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/head: No such file or directory
! e5e6e63...2926965 refs/pull/2501/head -> origin/pr/2501/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! b7b8c88...c7b289b refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 2a0d598...ecf3006 refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 6f01db6...0c7767e refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! 8382c3d...7965449 refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 76ca42f...14aff58 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! bbc031b...4e6f83f refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/head: No such file or directory
! d773fbd..9bac351 refs/pull/2509/head -> origin/pr/2509/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! b3a60fb...1eb90fa refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/head: No such file or directory
! 1ab6a9a..36f9d90 refs/pull/2512/head -> origin/pr/2512/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! f45dc4c...6d441b8 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 1f4c150...3b6ed4b refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! ca83009...5b30834 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fdbadfc9cceecf645f2325777ab32f1cb3041953 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fdbadfc9cceecf645f2325777ab32f1cb3041953
> git rev-list b2329a7eff1e2b660af1efcc0a58bc54a478bfdd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson267422978756379310.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2971533689719387357.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5463828583138577598.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6974279427301178420.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-15 00:02:52,823 24f0e108 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/24f0e108/pkb.log
2017-04-15 00:02:52,823 24f0e108 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-15 00:02:52,824 24f0e108 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-15 00:02:53,400 24f0e108 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-15 00:02:53,546 24f0e108 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-15 00:02:53,550 24f0e108 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-15 00:02:53,550 24f0e108 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-15 00:02:53,558 24f0e108 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-15 00:02:53,560 24f0e108 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-15 00:02:53,613 24f0e108 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-15 00:02:53,613 24f0e108 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/24f0e108/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #308
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/308/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-1347] Update protos related to State API for prototyping purposes.
[tgroh] Free PTransform Names if they are being Replaced
------------------------------------------
[...truncated 239.50 KB...]
remote: Counting objects: 5579, done.
remote: Compressing objects: 0% (1/460) remote: Compressing objects: 1% (5/460) remote: Compressing objects: 2% (10/460) remote: Compressing objects: 3% (14/460) remote: Compressing objects: 4% (19/460) remote: Compressing objects: 5% (23/460) remote: Compressing objects: 6% (28/460) remote: Compressing objects: 7% (33/460) remote: Compressing objects: 8% (37/460) remote: Compressing objects: 9% (42/460) remote: Compressing objects: 10% (46/460) remote: Compressing objects: 11% (51/460) remote: Compressing objects: 12% (56/460) remote: Compressing objects: 13% (60/460) remote: Compressing objects: 14% (65/460) remote: Compressing objects: 15% (69/460) remote: Compressing objects: 16% (74/460) remote: Compressing objects: 17% (79/460) remote: Compressing objects: 18% (83/460) remote: Compressing objects: 19% (88/460) remote: Compressing objects: 20% (92/460) remote: Compressing objects: 21% (97/460) remote: Compressing objects: 22% (102/460) remote: Compressing objects: 23% (106/460) remote: Compressing objects: 24% (111/460) remote: Compressing objects: 25% (115/460) remote: Compressing objects: 26% (120/460) remote: Compressing objects: 27% (125/460) remote: Compressing objects: 28% (129/460) remote: Compressing objects: 29% (134/460) remote: Compressing objects: 30% (138/460) remote: Compressing objects: 31% (143/460) remote: Compressing objects: 32% (148/460) remote: Compressing objects: 33% (152/460) remote: Compressing objects: 34% (157/460) remote: Compressing objects: 35% (161/460) remote: Compressing objects: 36% (166/460) remote: Compressing objects: 37% (171/460) remote: Compressing objects: 38% (175/460) remote: Compressing objects: 39% (180/460) remote: Compressing objects: 40% (184/460) remote: Compressing objects: 41% (189/460) remote: Compressing objects: 42% (194/460) remote: Compressing objects: 43% (198/460) remote: Compressing objects: 44% (203/460) remote: Compressing objects: 45% (207/460) remote: Compressing objects: 46% (212/460) remote: Compressing objects: 47% (217/460) remote: Compressing objects: 48% (221/460) remote: Compressing objects: 49% (226/460) remote: Compressing objects: 50% (230/460) remote: Compressing objects: 51% (235/460) remote: Compressing objects: 52% (240/460) remote: Compressing objects: 53% (244/460) remote: Compressing objects: 54% (249/460) remote: Compressing objects: 55% (253/460) remote: Compressing objects: 56% (258/460) remote: Compressing objects: 57% (263/460) remote: Compressing objects: 58% (267/460) remote: Compressing objects: 59% (272/460) remote: Compressing objects: 60% (276/460) remote: Compressing objects: 61% (281/460) remote: Compressing objects: 62% (286/460) remote: Compressing objects: 63% (290/460) remote: Compressing objects: 64% (295/460) remote: Compressing objects: 65% (299/460) remote: Compressing objects: 66% (304/460) remote: Compressing objects: 67% (309/460) remote: Compressing objects: 68% (313/460) remote: Compressing objects: 69% (318/460) remote: Compressing objects: 70% (322/460) remote: Compressing objects: 71% (327/460) remote: Compressing objects: 72% (332/460) remote: Compressing objects: 73% (336/460) remote: Compressing objects: 74% (341/460) remote: Compressing objects: 75% (345/460) remote: Compressing objects: 76% (350/460) remote: Compressing objects: 77% (355/460) remote: Compressing objects: 78% (359/460) remote: Compressing objects: 79% (364/460) remote: Compressing objects: 80% (368/460) remote: Compressing objects: 81% (373/460) remote: Compressing objects: 82% (378/460) remote: Compressing objects: 83% (382/460) remote: Compressing objects: 84% (387/460) remote: Compressing objects: 85% (391/460) remote: Compressing objects: 86% (396/460) remote: Compressing objects: 87% (401/460) remote: Compressing objects: 88% (405/460) remote: Compressing objects: 89% (410/460) remote: Compressing objects: 90% (414/460) remote: Compressing objects: 91% (419/460) remote: Compressing objects: 92% (424/460) remote: Compressing objects: 93% (428/460) remote: Compressing objects: 94% (433/460) remote: Compressing objects: 95% (437/460) remote: Compressing objects: 96% (442/460) remote: Compressing objects: 97% (447/460) remote: Compressing objects: 98% (451/460) remote: Compressing objects: 99% (456/460) remote: Compressing objects: 100% (460/460) remote: Compressing objects: 100% (460/460), done.
Receiving objects: 0% (1/5579) Receiving objects: 1% (56/5579) Receiving objects: 2% (112/5579) Receiving objects: 3% (168/5579) Receiving objects: 4% (224/5579) Receiving objects: 5% (279/5579) Receiving objects: 6% (335/5579) Receiving objects: 7% (391/5579) Receiving objects: 8% (447/5579) Receiving objects: 9% (503/5579) Receiving objects: 10% (558/5579) Receiving objects: 11% (614/5579) Receiving objects: 12% (670/5579) Receiving objects: 13% (726/5579) Receiving objects: 14% (782/5579) Receiving objects: 15% (837/5579) Receiving objects: 16% (893/5579) Receiving objects: 17% (949/5579) Receiving objects: 18% (1005/5579) Receiving objects: 19% (1061/5579) Receiving objects: 20% (1116/5579) Receiving objects: 21% (1172/5579) Receiving objects: 22% (1228/5579) Receiving objects: 23% (1284/5579) Receiving objects: 24% (1339/5579) Receiving objects: 25% (1395/5579) Receiving objects: 26% (1451/5579) Receiving objects: 27% (1507/5579) Receiving objects: 28% (1563/5579) Receiving objects: 29% (1618/5579) Receiving objects: 30% (1674/5579) Receiving objects: 31% (1730/5579) Receiving objects: 32% (1786/5579) Receiving objects: 33% (1842/5579) Receiving objects: 34% (1897/5579) Receiving objects: 35% (1953/5579) Receiving objects: 36% (2009/5579) Receiving objects: 37% (2065/5579) Receiving objects: 38% (2121/5579) Receiving objects: 39% (2176/5579) Receiving objects: 40% (2232/5579) Receiving objects: 41% (2288/5579) Receiving objects: 42% (2344/5579) Receiving objects: 43% (2399/5579) Receiving objects: 44% (2455/5579) Receiving objects: 45% (2511/5579) Receiving objects: 46% (2567/5579) Receiving objects: 47% (2623/5579) Receiving objects: 48% (2678/5579) Receiving objects: 49% (2734/5579) Receiving objects: 50% (2790/5579) Receiving objects: 51% (2846/5579) Receiving objects: 52% (2902/5579) Receiving objects: 53% (2957/5579) Receiving objects: 54% (3013/5579) Receiving objects: 55% (3069/5579) Receiving objects: 56% (3125/5579) Receiving objects: 57% (3181/5579) Receiving objects: 58% (3236/5579) Receiving objects: 59% (3292/5579) Receiving objects: 60% (3348/5579) Receiving objects: 61% (3404/5579) Receiving objects: 62% (3459/5579) Receiving objects: 63% (3515/5579) Receiving objects: 64% (3571/5579) Receiving objects: 65% (3627/5579) Receiving objects: 66% (3683/5579) Receiving objects: 67% (3738/5579) Receiving objects: 68% (3794/5579) Receiving objects: 69% (3850/5579) Receiving objects: 70% (3906/5579) Receiving objects: 71% (3962/5579) Receiving objects: 72% (4017/5579) Receiving objects: 73% (4073/5579) Receiving objects: 74% (4129/5579) Receiving objects: 75% (4185/5579) Receiving objects: 76% (4241/5579) Receiving objects: 77% (4296/5579) Receiving objects: 78% (4352/5579) Receiving objects: 79% (4408/5579) Receiving objects: 80% (4464/5579) Receiving objects: 81% (4519/5579) Receiving objects: 82% (4575/5579) Receiving objects: 83% (4631/5579) Receiving objects: 84% (4687/5579) Receiving objects: 85% (4743/5579) Receiving objects: 86% (4798/5579) Receiving objects: 87% (4854/5579) Receiving objects: 88% (4910/5579) Receiving objects: 89% (4966/5579) Receiving objects: 90% (5022/5579) Receiving objects: 91% (5077/5579) Receiving objects: 92% (5133/5579) Receiving objects: 93% (5189/5579) Receiving objects: 94% (5245/5579) Receiving objects: 95% (5301/5579) Receiving objects: 96% (5356/5579) Receiving objects: 97% (5412/5579) Receiving objects: 98% (5468/5579) remote: Total 5579 (delta 1891), reused 1662 (delta 1662), pack-reused 3227
Receiving objects: 99% (5524/5579) Receiving objects: 100% (5579/5579) Receiving objects: 100% (5579/5579), 782.76 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/2048) Resolving deltas: 1% (28/2048) Resolving deltas: 2% (41/2048) Resolving deltas: 3% (66/2048) Resolving deltas: 4% (82/2048) Resolving deltas: 5% (103/2048) Resolving deltas: 6% (124/2048) Resolving deltas: 7% (144/2048) Resolving deltas: 8% (174/2048) Resolving deltas: 9% (192/2048) Resolving deltas: 10% (213/2048) Resolving deltas: 11% (226/2048) Resolving deltas: 17% (351/2048) Resolving deltas: 18% (372/2048) Resolving deltas: 19% (390/2048) Resolving deltas: 20% (414/2048) Resolving deltas: 21% (431/2048) Resolving deltas: 22% (452/2048) Resolving deltas: 23% (474/2048) Resolving deltas: 24% (493/2048) Resolving deltas: 25% (516/2048) Resolving deltas: 26% (543/2048) Resolving deltas: 27% (554/2048) Resolving deltas: 28% (576/2048) Resolving deltas: 29% (597/2048) Resolving deltas: 30% (617/2048) Resolving deltas: 31% (639/2048) Resolving deltas: 32% (665/2048) Resolving deltas: 33% (682/2048) Resolving deltas: 34% (709/2048) Resolving deltas: 35% (717/2048) Resolving deltas: 36% (746/2048) Resolving deltas: 37% (758/2048) Resolving deltas: 38% (782/2048) Resolving deltas: 39% (804/2048) Resolving deltas: 40% (829/2048) Resolving deltas: 41% (847/2048) Resolving deltas: 42% (863/2048) Resolving deltas: 43% (883/2048) Resolving deltas: 44% (908/2048) Resolving deltas: 45% (926/2048) Resolving deltas: 46% (943/2048) Resolving deltas: 47% (967/2048) Resolving deltas: 48% (986/2048) Resolving deltas: 49% (1013/2048) Resolving deltas: 50% (1031/2048) Resolving deltas: 51% (1048/2048) Resolving deltas: 52% (1067/2048) Resolving deltas: 53% (1086/2048) Resolving deltas: 54% (1106/2048) Resolving deltas: 55% (1129/2048) Resolving deltas: 56% (1149/2048) Resolving deltas: 57% (1171/2048) Resolving deltas: 58% (1188/2048) Resolving deltas: 59% (1209/2048) Resolving deltas: 60% (1231/2048) Resolving deltas: 61% (1250/2048) Resolving deltas: 62% (1270/2048) Resolving deltas: 63% (1292/2048) Resolving deltas: 64% (1312/2048) Resolving deltas: 65% (1340/2048) Resolving deltas: 66% (1352/2048) Resolving deltas: 67% (1373/2048) Resolving deltas: 68% (1396/2048) Resolving deltas: 69% (1415/2048) Resolving deltas: 70% (1436/2048) Resolving deltas: 71% (1456/2048) Resolving deltas: 72% (1475/2048) Resolving deltas: 73% (1497/2048) Resolving deltas: 74% (1516/2048) Resolving deltas: 75% (1536/2048) Resolving deltas: 76% (1557/2048) Resolving deltas: 77% (1587/2048) Resolving deltas: 78% (1598/2048) Resolving deltas: 79% (1619/2048) Resolving deltas: 80% (1639/2048) Resolving deltas: 81% (1660/2048) Resolving deltas: 82% (1689/2048) Resolving deltas: 83% (1701/2048) Resolving deltas: 84% (1722/2048) Resolving deltas: 85% (1742/2048) Resolving deltas: 86% (1762/2048) Resolving deltas: 87% (1782/2048) Resolving deltas: 88% (1803/2048) Resolving deltas: 89% (1824/2048) Resolving deltas: 90% (1844/2048) Resolving deltas: 91% (1864/2048) Resolving deltas: 92% (1886/2048) Resolving deltas: 93% (1910/2048) Resolving deltas: 94% (1926/2048) Resolving deltas: 95% (1946/2048) Resolving deltas: 96% (1969/2048) Resolving deltas: 97% (1988/2048) Resolving deltas: 98% (2008/2048) Resolving deltas: 99% (2028/2048) Resolving deltas: 100% (2048/2048) Resolving deltas: 100% (2048/2048), completed with 657 local objects.
4daac66..b2329a7 master -> origin/master
error: unable to resolve reference refs/remotes/origin/pr/1687/merge: No such file or directory
! 2015abe...19c09b1 refs/pull/1687/merge -> origin/pr/1687/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1725/merge: No such file or directory
! 41265ef...34ca686 refs/pull/1725/merge -> origin/pr/1725/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1729/merge: No such file or directory
! 3335bab...8554e02 refs/pull/1729/merge -> origin/pr/1729/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1851/merge: No such file or directory
! e0ed99c...77df100 refs/pull/1851/merge -> origin/pr/1851/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1898/merge: No such file or directory
! ce64239...91f1cc1 refs/pull/1898/merge -> origin/pr/1898/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 11a2c09...c50d1aa refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! 46b8c09...54e1d12 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! 559b5e1...7ba8ef3 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! 817e86b...bca64ae refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! 7bf8029...1f3d75a refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! 103c0ee...51430f7 refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 3243566...b3cddb5 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 61f99a7...9e270df refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 6de1e89...10e75d3 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 76ede54...7823062 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 6403375...745679b refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 13ec031...30358cc refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! c687718...25caa4e refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 9f61985...c2c61e1 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/head: No such file or directory
! ec66c98...e68a9d8 refs/pull/2415/head -> origin/pr/2415/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! ddb1eb9...b39699d refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! b11d06e...e2d37e8 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! b5e2998...e67e4ee refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! bbb87fd...6709514 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 11cc019...9f60c28 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2447/head: No such file or directory
! b37c9b3..093665a refs/pull/2447/head -> origin/pr/2447/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 8f1c300...6428fda refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! 1b02fd0...84ed5b5 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 74c2dbc...bfe9cd8 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 5dbcc2f...f9610fe refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 7d77352...00dc4b6 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! bd48535...d4e30ab refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! cac665b...650a5a5 refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/head: No such file or directory
! c050088...e5e6e63 refs/pull/2501/head -> origin/pr/2501/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! 8c9c850...b7b8c88 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/head: No such file or directory
! 530ef12..9d42c8f refs/pull/2506/head -> origin/pr/2506/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! 4b61e9a...8382c3d refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 9889dc1...76ca42f refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! bc80fc2...bbc031b refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! fd2fa2f...b3a60fb refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! 861da53...f45dc4c refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! cf4f460...ca83009 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b2329a7eff1e2b660af1efcc0a58bc54a478bfdd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b2329a7eff1e2b660af1efcc0a58bc54a478bfdd
> git rev-list 4daac664426da06268fa84a0a07793f818ce3913 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6233322227702473774.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1481912878223435571.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2446318397074000493.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson200514322324925540.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-14 18:02:48,869 ad738d49 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/ad738d49/pkb.log
2017-04-14 18:02:48,869 ad738d49 MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-14 18:02:48,870 ad738d49 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-14 18:02:48,963 ad738d49 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-14 18:02:49,055 ad738d49 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-14 18:02:49,057 ad738d49 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-14 18:02:49,058 ad738d49 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-14 18:02:49,063 ad738d49 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-14 18:02:49,065 ad738d49 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-14 18:02:49,086 ad738d49 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-14 18:02:49,087 ad738d49 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/ad738d49/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #307
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/307/display/redirect>
------------------------------------------
[...truncated 237.11 KB...]
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1644, done.
remote: Compressing objects: 2% (1/42) remote: Compressing objects: 4% (2/42) remote: Compressing objects: 7% (3/42) remote: Compressing objects: 9% (4/42) remote: Compressing objects: 11% (5/42) remote: Compressing objects: 14% (6/42) remote: Compressing objects: 16% (7/42) remote: Compressing objects: 19% (8/42) remote: Compressing objects: 21% (9/42) remote: Compressing objects: 23% (10/42) remote: Compressing objects: 26% (11/42) remote: Compressing objects: 28% (12/42) remote: Compressing objects: 30% (13/42) remote: Compressing objects: 33% (14/42) remote: Compressing objects: 35% (15/42) remote: Compressing objects: 38% (16/42) remote: Compressing objects: 40% (17/42) remote: Compressing objects: 42% (18/42) remote: Compressing objects: 45% (19/42) remote: Compressing objects: 47% (20/42) remote: Compressing objects: 50% (21/42) remote: Compressing objects: 52% (22/42) remote: Compressing objects: 54% (23/42) remote: Compressing objects: 57% (24/42) remote: Compressing objects: 59% (25/42) remote: Compressing objects: 61% (26/42) remote: Compressing objects: 64% (27/42) remote: Compressing objects: 66% (28/42) remote: Compressing objects: 69% (29/42) remote: Compressing objects: 71% (30/42) remote: Compressing objects: 73% (31/42) remote: Compressing objects: 76% (32/42) remote: Compressing objects: 78% (33/42) remote: Compressing objects: 80% (34/42) remote: Compressing objects: 83% (35/42) remote: Compressing objects: 85% (36/42) remote: Compressing objects: 88% (37/42) remote: Compressing objects: 90% (38/42) remote: Compressing objects: 92% (39/42) remote: Compressing objects: 95% (40/42) remote: Compressing objects: 97% (41/42) remote: Compressing objects: 100% (42/42) remote: Compressing objects: 100% (42/42), done.
Receiving objects: 0% (1/1644) Receiving objects: 1% (17/1644) Receiving objects: 2% (33/1644) Receiving objects: 3% (50/1644) Receiving objects: 4% (66/1644) Receiving objects: 5% (83/1644) Receiving objects: 6% (99/1644) Receiving objects: 7% (116/1644) Receiving objects: 8% (132/1644) Receiving objects: 9% (148/1644) Receiving objects: 10% (165/1644) Receiving objects: 11% (181/1644) Receiving objects: 12% (198/1644) Receiving objects: 13% (214/1644) Receiving objects: 14% (231/1644) Receiving objects: 15% (247/1644) Receiving objects: 16% (264/1644) Receiving objects: 17% (280/1644) Receiving objects: 18% (296/1644) Receiving objects: 19% (313/1644) Receiving objects: 20% (329/1644) Receiving objects: 21% (346/1644) Receiving objects: 22% (362/1644) Receiving objects: 23% (379/1644) Receiving objects: 24% (395/1644) Receiving objects: 25% (411/1644) Receiving objects: 26% (428/1644) Receiving objects: 27% (444/1644) Receiving objects: 28% (461/1644) Receiving objects: 29% (477/1644) Receiving objects: 30% (494/1644) Receiving objects: 31% (510/1644) Receiving objects: 32% (527/1644) Receiving objects: 33% (543/1644) Receiving objects: 34% (559/1644) Receiving objects: 35% (576/1644) Receiving objects: 36% (592/1644) Receiving objects: 37% (609/1644) Receiving objects: 38% (625/1644) Receiving objects: 39% (642/1644) Receiving objects: 40% (658/1644) Receiving objects: 41% (675/1644) Receiving objects: 42% (691/1644) Receiving objects: 43% (707/1644) Receiving objects: 44% (724/1644) Receiving objects: 45% (740/1644) Receiving objects: 46% (757/1644) Receiving objects: 47% (773/1644) Receiving objects: 48% (790/1644) Receiving objects: 49% (806/1644) Receiving objects: 50% (822/1644) Receiving objects: 51% (839/1644) Receiving objects: 52% (855/1644) Receiving objects: 53% (872/1644) Receiving objects: 54% (888/1644) Receiving objects: 55% (905/1644) Receiving objects: 56% (921/1644) Receiving objects: 57% (938/1644) Receiving objects: 58% (954/1644) Receiving objects: 59% (970/1644) Receiving objects: 60% (987/1644) Receiving objects: 61% (1003/1644) Receiving objects: 62% (1020/1644) Receiving objects: 63% (1036/1644) Receiving objects: 64% (1053/1644) Receiving objects: 65% (1069/1644) Receiving objects: 66% (1086/1644) Receiving objects: 67% (1102/1644) Receiving objects: 68% (1118/1644) Receiving objects: 69% (1135/1644) Receiving objects: 70% (1151/1644) Receiving objects: 71% (1168/1644) Receiving objects: 72% (1184/1644) Receiving objects: 73% (1201/1644) Receiving objects: 74% (1217/1644) Receiving objects: 75% (1233/1644) Receiving objects: 76% (1250/1644) Receiving objects: 77% (1266/1644) Receiving objects: 78% (1283/1644) Receiving objects: 79% (1299/1644) Receiving objects: 80% (1316/1644) Receiving objects: 81% (1332/1644) Receiving objects: 82% (1349/1644) Receiving objects: 83% (1365/1644) Receiving objects: 84% (1381/1644) Receiving objects: 85% (1398/1644) Receiving objects: 86% (1414/1644) Receiving objects: 87% (1431/1644) Receiving objects: 88% (1447/1644) Receiving objects: 89% (1464/1644) Receiving objects: 90% (1480/1644) Receiving objects: 91% (1497/1644) Receiving objects: 92% (1513/1644) Receiving objects: 93% (1529/1644) Receiving objects: 94% (1546/1644) Receiving objects: 95% (1562/1644) Receiving objects: 96% (1579/1644) Receiving objects: 97% (1595/1644) remote: Total 1644 (delta 648), reused 625 (delta 625), pack-reused 973
Receiving objects: 98% (1612/1644) Receiving objects: 99% (1628/1644) Receiving objects: 100% (1644/1644) Receiving objects: 100% (1644/1644), 178.75 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/669) Resolving deltas: 1% (7/669) Resolving deltas: 2% (14/669) Resolving deltas: 4% (27/669) Resolving deltas: 5% (34/669) Resolving deltas: 6% (44/669) Resolving deltas: 8% (55/669) Resolving deltas: 9% (66/669) Resolving deltas: 10% (70/669) Resolving deltas: 11% (74/669) Resolving deltas: 12% (81/669) Resolving deltas: 13% (87/669) Resolving deltas: 14% (94/669) Resolving deltas: 15% (103/669) Resolving deltas: 16% (108/669) Resolving deltas: 17% (114/669) Resolving deltas: 18% (121/669) Resolving deltas: 19% (128/669) Resolving deltas: 20% (135/669) Resolving deltas: 21% (144/669) Resolving deltas: 22% (148/669) Resolving deltas: 23% (155/669) Resolving deltas: 24% (161/669) Resolving deltas: 25% (169/669) Resolving deltas: 26% (174/669) Resolving deltas: 27% (182/669) Resolving deltas: 28% (188/669) Resolving deltas: 29% (195/669) Resolving deltas: 30% (201/669) Resolving deltas: 32% (216/669) Resolving deltas: 33% (223/669) Resolving deltas: 34% (229/669) Resolving deltas: 35% (236/669) Resolving deltas: 36% (243/669) Resolving deltas: 37% (250/669) Resolving deltas: 38% (257/669) Resolving deltas: 39% (263/669) Resolving deltas: 40% (271/669) Resolving deltas: 41% (275/669) Resolving deltas: 42% (281/669) Resolving deltas: 43% (292/669) Resolving deltas: 44% (295/669) Resolving deltas: 45% (304/669) Resolving deltas: 46% (309/669) Resolving deltas: 47% (315/669) Resolving deltas: 48% (323/669) Resolving deltas: 49% (329/669) Resolving deltas: 50% (337/669) Resolving deltas: 51% (342/669) Resolving deltas: 52% (348/669) Resolving deltas: 53% (358/669) Resolving deltas: 54% (362/669) Resolving deltas: 55% (368/669) Resolving deltas: 56% (375/669) Resolving deltas: 57% (382/669) Resolving deltas: 58% (389/669) Resolving deltas: 59% (395/669) Resolving deltas: 60% (403/669) Resolving deltas: 61% (409/669) Resolving deltas: 62% (416/669) Resolving deltas: 63% (423/669) Resolving deltas: 64% (429/669) Resolving deltas: 65% (437/669) Resolving deltas: 66% (443/669) Resolving deltas: 67% (449/669) Resolving deltas: 68% (455/669) Resolving deltas: 69% (463/669) Resolving deltas: 70% (469/669) Resolving deltas: 71% (475/669) Resolving deltas: 72% (483/669) Resolving deltas: 73% (489/669) Resolving deltas: 74% (496/669) Resolving deltas: 75% (502/669) Resolving deltas: 76% (510/669) Resolving deltas: 77% (516/669) Resolving deltas: 78% (523/669) Resolving deltas: 79% (530/669) Resolving deltas: 80% (536/669) Resolving deltas: 81% (542/669) Resolving deltas: 82% (550/669) Resolving deltas: 83% (556/669) Resolving deltas: 84% (562/669) Resolving deltas: 85% (569/669) Resolving deltas: 86% (577/669) Resolving deltas: 87% (583/669) Resolving deltas: 88% (589/669) Resolving deltas: 89% (596/669) Resolving deltas: 90% (603/669) Resolving deltas: 91% (609/669) Resolving deltas: 92% (622/669) Resolving deltas: 93% (624/669) Resolving deltas: 94% (629/669) Resolving deltas: 95% (638/669) Resolving deltas: 96% (643/669) Resolving deltas: 97% (649/669) Resolving deltas: 98% (656/669) Resolving deltas: 99% (663/669) Resolving deltas: 100% (669/669) Resolving deltas: 100% (669/669), completed with 326 local objects.
error: unable to resolve reference refs/remotes/origin/pr/1632/merge: No such file or directory
! 9601ddc...8939a82 refs/pull/1632/merge -> origin/pr/1632/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2117/merge: No such file or directory
! 63e51d2...d2fcfb2 refs/pull/2117/merge -> origin/pr/2117/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2167/merge: No such file or directory
! 3afa157...e5df450 refs/pull/2167/merge -> origin/pr/2167/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2239/merge: No such file or directory
! b26429c...9919809 refs/pull/2239/merge -> origin/pr/2239/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2312/merge: No such file or directory
! e94139f...3d22125 refs/pull/2312/merge -> origin/pr/2312/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2326/merge: No such file or directory
! 86d0009...aa6ce40 refs/pull/2326/merge -> origin/pr/2326/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2329/merge: No such file or directory
! fa2aa3b...57774c1 refs/pull/2329/merge -> origin/pr/2329/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 754d078...4d3e7cf refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/head: No such file or directory
! a69b46b...0035e6c refs/pull/2406/head -> origin/pr/2406/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 373ff7f...9f61985 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! e5c16ef...52eae97 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! b42c26f...0d0bb75 refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! aaa9667...d770a09 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! c20b9a6...3f65416 refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! b62e07f...2a0d598 refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 1229edd...6f01db6 refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 44217fd...658fc7a refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! b7373ee...b6c8397 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 5a1ef91...8df0158 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 9bcff36...1f4c150 refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4daac664426da06268fa84a0a07793f818ce3913 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4daac664426da06268fa84a0a07793f818ce3913
> git rev-list 4daac664426da06268fa84a0a07793f818ce3913 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5501953256838239165.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson870941049174941019.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6001211396158323315.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson189230272472657798.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-14 12:02:05,497 2ccbd7f6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/2ccbd7f6/pkb.log
2017-04-14 12:02:05,497 2ccbd7f6 MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-14 12:02:05,498 2ccbd7f6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-14 12:02:05,740 2ccbd7f6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-14 12:02:05,823 2ccbd7f6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-14 12:02:05,825 2ccbd7f6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-14 12:02:05,826 2ccbd7f6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-14 12:02:05,831 2ccbd7f6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-14 12:02:05,833 2ccbd7f6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-14 12:02:05,859 2ccbd7f6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-14 12:02:05,860 2ccbd7f6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/2ccbd7f6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #306
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/306/display/redirect?page=changes>
Changes:
[altay] [BEAM-1964] Fix lint issues for linter upgrade
[altay] fix the simplest typo
[altay] Update java8 examples pom files to include maven-shade-plugin.
------------------------------------------
[...truncated 248.73 KB...]
Resolving deltas: 0% (0/1484) Resolving deltas: 1% (16/1484) Resolving deltas: 2% (30/1484) Resolving deltas: 3% (47/1484) Resolving deltas: 4% (67/1484) Resolving deltas: 5% (75/1484) Resolving deltas: 6% (90/1484) Resolving deltas: 7% (108/1484) Resolving deltas: 9% (135/1484) Resolving deltas: 13% (203/1484) Resolving deltas: 16% (248/1484) Resolving deltas: 17% (261/1484) Resolving deltas: 19% (285/1484) Resolving deltas: 20% (297/1484) Resolving deltas: 21% (312/1484) Resolving deltas: 22% (328/1484) Resolving deltas: 23% (343/1484) Resolving deltas: 24% (357/1484) Resolving deltas: 25% (371/1484) Resolving deltas: 26% (390/1484) Resolving deltas: 27% (401/1484) Resolving deltas: 28% (426/1484) Resolving deltas: 29% (444/1484) Resolving deltas: 30% (446/1484) Resolving deltas: 31% (461/1484) Resolving deltas: 32% (480/1484) Resolving deltas: 33% (501/1484) Resolving deltas: 34% (506/1484) Resolving deltas: 35% (520/1484) Resolving deltas: 36% (537/1484) Resolving deltas: 37% (551/1484) Resolving deltas: 38% (565/1484) Resolving deltas: 39% (579/1484) Resolving deltas: 40% (595/1484) Resolving deltas: 41% (612/1484) Resolving deltas: 42% (624/1484) Resolving deltas: 43% (639/1484) Resolving deltas: 44% (664/1484) Resolving deltas: 45% (677/1484) Resolving deltas: 46% (694/1484) Resolving deltas: 47% (702/1484) Resolving deltas: 48% (717/1484) Resolving deltas: 49% (731/1484) Resolving deltas: 50% (742/1484) Resolving deltas: 51% (757/1484) Resolving deltas: 52% (780/1484) Resolving deltas: 53% (792/1484) Resolving deltas: 54% (810/1484) Resolving deltas: 55% (817/1484) Resolving deltas: 56% (832/1484) Resolving deltas: 57% (846/1484) Resolving deltas: 58% (861/1484) Resolving deltas: 59% (876/1484) Resolving deltas: 60% (892/1484) Resolving deltas: 61% (907/1484) Resolving deltas: 62% (923/1484) Resolving deltas: 63% (935/1484) Resolving deltas: 64% (950/1484) Resolving deltas: 65% (965/1484) Resolving deltas: 66% (981/1484) Resolving deltas: 67% (995/1484) Resolving deltas: 68% (1010/1484) Resolving deltas: 69% (1024/1484) Resolving deltas: 70% (1039/1484) Resolving deltas: 71% (1054/1484) Resolving deltas: 72% (1069/1484) Resolving deltas: 73% (1090/1484) Resolving deltas: 74% (1100/1484) Resolving deltas: 75% (1113/1484) Resolving deltas: 76% (1128/1484) Resolving deltas: 77% (1143/1484) Resolving deltas: 78% (1159/1484) Resolving deltas: 79% (1175/1484) Resolving deltas: 80% (1189/1484) Resolving deltas: 81% (1206/1484) Resolving deltas: 82% (1224/1484) Resolving deltas: 83% (1234/1484) Resolving deltas: 84% (1248/1484) Resolving deltas: 85% (1263/1484) Resolving deltas: 86% (1277/1484) Resolving deltas: 87% (1292/1484) Resolving deltas: 88% (1306/1484) Resolving deltas: 89% (1322/1484) Resolving deltas: 90% (1336/1484) Resolving deltas: 91% (1351/1484) Resolving deltas: 92% (1367/1484) Resolving deltas: 93% (1381/1484) Resolving deltas: 94% (1395/1484) Resolving deltas: 95% (1410/1484) Resolving deltas: 96% (1425/1484) Resolving deltas: 97% (1440/1484) Resolving deltas: 98% (1455/1484) Resolving deltas: 99% (1470/1484) Resolving deltas: 100% (1484/1484) Resolving deltas: 100% (1484/1484), completed with 522 local objects.
3fb75d3..4daac66 master -> origin/master
error: unable to resolve reference refs/remotes/origin/pr/1687/merge: No such file or directory
! 6ee392f...2015abe refs/pull/1687/merge -> origin/pr/1687/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1725/merge: No such file or directory
! f3dc640...41265ef refs/pull/1725/merge -> origin/pr/1725/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1729/merge: No such file or directory
! 8afd986...3335bab refs/pull/1729/merge -> origin/pr/1729/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1851/merge: No such file or directory
! e3df4cd...e0ed99c refs/pull/1851/merge -> origin/pr/1851/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1898/merge: No such file or directory
! cb4974c...ce64239 refs/pull/1898/merge -> origin/pr/1898/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 4f67125...11a2c09 refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! 97ab054...46b8c09 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! ba0f299...559b5e1 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! ebaa3fc...817e86b refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! 363eff3...7bf8029 refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2255/merge: No such file or directory
! 758fa72...65f9c59 refs/pull/2255/merge -> origin/pr/2255/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! c0ceaef...103c0ee refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 8dcfc0c...3243566 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 475d1a3...61f99a7 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! ea1a1c1...6de1e89 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! a15b8bc...76ede54 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 2885312...6403375 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! fd7b79c...13ec031 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2350/merge: No such file or directory
! 4c4970e...2e27515 refs/pull/2350/merge -> origin/pr/2350/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! e659631...c687718 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! 0b9e094...c30ae40 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 01efd4d...373ff7f refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 57fedf9...aebc993 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 6f97586...772230a refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 9be1fc4...b11d06e refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! af0d020...b5e2998 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 08315f8...bbb87fd refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 7c181c3...11cc019 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 123b26a...1f9e3f0 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! c73f8d3...8f1c300 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! bd8b07b...1b02fd0 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! d0ebd40...74c2dbc refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 18340dd...5dbcc2f refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 0759a55...7d77352 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 0a65fc5...1820056 refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! 33b60a2...bf83e88 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! a608a0b...bd48535 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! 090ce4f...cac665b refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! bd5aa11...8c9c850 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! e41ddce...4b61e9a refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! ed025b6...9889dc1 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! e7a05ab...bc80fc2 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! fbfb12c...fd2fa2f refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! 00882e5...861da53 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 799a2d2...cf4f460 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4daac664426da06268fa84a0a07793f818ce3913 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4daac664426da06268fa84a0a07793f818ce3913
> git rev-list 3fb75d3c22a7988ba9ab05af986aa3594bc7b7f8 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9141185549414477474.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8873518343541925115.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7562927529858110220.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3197819248922753774.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-14 06:02:15,548 258d4cff MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/258d4cff/pkb.log
2017-04-14 06:02:15,548 258d4cff MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-14 06:02:15,549 258d4cff MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-14 06:02:15,644 258d4cff MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-14 06:02:15,733 258d4cff MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-14 06:02:15,735 258d4cff MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-14 06:02:15,735 258d4cff MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-14 06:02:15,740 258d4cff MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-14 06:02:15,742 258d4cff MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-14 06:02:15,765 258d4cff MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-14 06:02:15,766 258d4cff MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/258d4cff/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #305
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/305/display/redirect?page=changes>
Changes:
[altay] Pin versions in tox script
[altay] Update user_score.py
[sourabhbajaj] [BEAM-1101, BEAM-1068] Remove service account name credential pipeline
[altay] Improve gcloud logging message
[altay] [BEAM-1708] Improve error message when GCP not installed
[dhalperi] Remove Triggers.java from SDK entirely
[dhalperi] Merge PR#2423: Add Kubernetes scripts for clusters for Performance and
------------------------------------------
[...truncated 257.47 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2289/merge: No such file or directory
! f2cd85f...65b38a8 refs/pull/2289/merge -> origin/pr/2289/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 08461a1...ea1a1c1 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 00175d7...a15b8bc refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 6829e8e...2885312 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! a88c6b1...fd7b79c refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2350/merge: No such file or directory
! c7799e0...4c4970e refs/pull/2350/merge -> origin/pr/2350/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 2f534a5...e659631 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 9bedccd...27660d8 refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! 3b11d5e...0b9e094 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 241ec60...0da4bb9 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 83f1610...01efd4d refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2407/merge: No such file or directory
! 62ddf5b...774b88a refs/pull/2407/merge -> origin/pr/2407/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! f06b0c8...57fedf9 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2411/merge: No such file or directory
! a96af72...c155a44 refs/pull/2411/merge -> origin/pr/2411/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2412/merge: No such file or directory
! 8d36b9c...4549102 refs/pull/2412/merge -> origin/pr/2412/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 49fd3ee...6f97586 refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! fad0cc2...9be1fc4 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 1f4bba2...af0d020 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 55ee39c...7da0ba1 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! af76f0b...08315f8 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! ccb8287...a471275 refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2441/merge: No such file or directory
! d341a1b...ce97533 refs/pull/2441/merge -> origin/pr/2441/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 8b033b5...7c181c3 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! c0618d2...123b26a refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 1625a1c...c73f8d3 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! ba6b2d3...bd8b07b refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2461/merge: No such file or directory
! 6555c33...00efdeb refs/pull/2461/merge -> origin/pr/2461/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2465/merge: No such file or directory
! e5301bd...1209746 refs/pull/2465/merge -> origin/pr/2465/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2467/merge: No such file or directory
! 3a6875d...4c793da refs/pull/2467/merge -> origin/pr/2467/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 9364d32...d0ebd40 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 73f96ad...18340dd refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2477/merge: No such file or directory
! 2de0590...a5f1d39 refs/pull/2477/merge -> origin/pr/2477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! d9434ad...0759a55 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 9c47b5c...0a65fc5 refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! 46abcbb...b9663eb refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! 96ce1b5...33b60a2 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! 47d17e2...a608a0b refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! 9c11f1a...ee5fed4 refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 7824d0b...b42c26f refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! 9b1a760...aaa9667 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! 6092c2f...090ce4f refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! a32caf8...bd5aa11 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! feffeba...e41ddce refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 9ebb97d...ed025b6 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 2916983...e7a05ab refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 3592759...fbfb12c refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! b318838...00882e5 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2513/merge: No such file or directory
! dede701...2b0b540 refs/pull/2513/merge -> origin/pr/2513/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 6b345b9...9bcff36 refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 7c50303...799a2d2 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3fb75d3c22a7988ba9ab05af986aa3594bc7b7f8 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3fb75d3c22a7988ba9ab05af986aa3594bc7b7f8
> git rev-list 2f400e2ac6e1375858d52ecd03af0993de13ad64 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3123439972056288140.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5676321341982371468.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2867923030602670394.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8703219437558408318.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-14 00:02:28,384 819e6a7b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/819e6a7b/pkb.log
2017-04-14 00:02:28,385 819e6a7b MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-14 00:02:28,385 819e6a7b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-14 00:02:28,637 819e6a7b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-14 00:02:28,721 819e6a7b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-14 00:02:28,723 819e6a7b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-14 00:02:28,723 819e6a7b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-14 00:02:28,729 819e6a7b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-14 00:02:28,731 819e6a7b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-14 00:02:28,755 819e6a7b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-14 00:02:28,755 819e6a7b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/819e6a7b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #304
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/304/display/redirect?page=changes>
Changes:
[lcwik] Test all Known Coders to ensure they Serialize via URN
[tgroh] Represent a Pipeline via a list of Top-level Transforms
[tgroh] Improve Empty Create Default Coder Error Message
------------------------------------------
[...truncated 239.50 KB...]
remote: Counting objects: 4174, done.
remote: Compressing objects: 0% (1/388) remote: Compressing objects: 1% (4/388) remote: Compressing objects: 2% (8/388) remote: Compressing objects: 3% (12/388) remote: Compressing objects: 4% (16/388) remote: Compressing objects: 5% (20/388) remote: Compressing objects: 6% (24/388) remote: Compressing objects: 7% (28/388) remote: Compressing objects: 8% (32/388) remote: Compressing objects: 9% (35/388) remote: Compressing objects: 10% (39/388) remote: Compressing objects: 11% (43/388) remote: Compressing objects: 12% (47/388) remote: Compressing objects: 13% (51/388) remote: Compressing objects: 14% (55/388) remote: Compressing objects: 15% (59/388) remote: Compressing objects: 16% (63/388) remote: Compressing objects: 17% (66/388) remote: Compressing objects: 18% (70/388) remote: Compressing objects: 19% (74/388) remote: Compressing objects: 20% (78/388) remote: Compressing objects: 21% (82/388) remote: Compressing objects: 22% (86/388) remote: Compressing objects: 23% (90/388) remote: Compressing objects: 24% (94/388) remote: Compressing objects: 25% (97/388) remote: Compressing objects: 26% (101/388) remote: Compressing objects: 27% (105/388) remote: Compressing objects: 28% (109/388) remote: Compressing objects: 29% (113/388) remote: Compressing objects: 30% (117/388) remote: Compressing objects: 31% (121/388) remote: Compressing objects: 32% (125/388) remote: Compressing objects: 33% (129/388) remote: Compressing objects: 34% (132/388) remote: Compressing objects: 35% (136/388) remote: Compressing objects: 36% (140/388) remote: Compressing objects: 37% (144/388) remote: Compressing objects: 38% (148/388) remote: Compressing objects: 39% (152/388) remote: Compressing objects: 40% (156/388) remote: Compressing objects: 41% (160/388) remote: Compressing objects: 42% (163/388) remote: Compressing objects: 43% (167/388) remote: Compressing objects: 44% (171/388) remote: Compressing objects: 45% (175/388) remote: Compressing objects: 46% (179/388) remote: Compressing objects: 47% (183/388) remote: Compressing objects: 48% (187/388) remote: Compressing objects: 49% (191/388) remote: Compressing objects: 50% (194/388) remote: Compressing objects: 51% (198/388) remote: Compressing objects: 52% (202/388) remote: Compressing objects: 53% (206/388) remote: Compressing objects: 54% (210/388) remote: Compressing objects: 55% (214/388) remote: Compressing objects: 56% (218/388) remote: Compressing objects: 57% (222/388) remote: Compressing objects: 58% (226/388) remote: Compressing objects: 59% (229/388) remote: Compressing objects: 60% (233/388) remote: Compressing objects: 61% (237/388) remote: Compressing objects: 62% (241/388) remote: Compressing objects: 63% (245/388) remote: Compressing objects: 64% (249/388) remote: Compressing objects: 65% (253/388) remote: Compressing objects: 66% (257/388) remote: Compressing objects: 67% (260/388) remote: Compressing objects: 68% (264/388) remote: Compressing objects: 69% (268/388) remote: Compressing objects: 70% (272/388) remote: Compressing objects: 71% (276/388) remote: Compressing objects: 72% (280/388) remote: Compressing objects: 73% (284/388) remote: Compressing objects: 74% (288/388) remote: Compressing objects: 75% (291/388) remote: Compressing objects: 76% (295/388) remote: Compressing objects: 77% (299/388) remote: Compressing objects: 78% (303/388) remote: Compressing objects: 79% (307/388) remote: Compressing objects: 80% (311/388) remote: Compressing objects: 81% (315/388) remote: Compressing objects: 82% (319/388) remote: Compressing objects: 83% (323/388) remote: Compressing objects: 84% (326/388) remote: Compressing objects: 85% (330/388) remote: Compressing objects: 86% (334/388) remote: Compressing objects: 87% (338/388) remote: Compressing objects: 88% (342/388) remote: Compressing objects: 89% (346/388) remote: Compressing objects: 90% (350/388) remote: Compressing objects: 91% (354/388) remote: Compressing objects: 92% (357/388) remote: Compressing objects: 93% (361/388) remote: Compressing objects: 94% (365/388) remote: Compressing objects: 95% (369/388) remote: Compressing objects: 96% (373/388) remote: Compressing objects: 97% (377/388) remote: Compressing objects: 98% (381/388) remote: Compressing objects: 99% (385/388) remote: Compressing objects: 100% (388/388) remote: Compressing objects: 100% (388/388), done.
Receiving objects: 0% (1/4174) Receiving objects: 1% (42/4174) Receiving objects: 2% (84/4174) Receiving objects: 3% (126/4174) Receiving objects: 4% (167/4174) Receiving objects: 5% (209/4174) Receiving objects: 6% (251/4174) Receiving objects: 7% (293/4174) Receiving objects: 8% (334/4174) Receiving objects: 9% (376/4174) Receiving objects: 10% (418/4174) Receiving objects: 11% (460/4174) Receiving objects: 12% (501/4174) Receiving objects: 13% (543/4174) Receiving objects: 14% (585/4174) Receiving objects: 15% (627/4174) Receiving objects: 16% (668/4174) Receiving objects: 17% (710/4174) Receiving objects: 18% (752/4174) Receiving objects: 19% (794/4174) Receiving objects: 20% (835/4174) Receiving objects: 21% (877/4174) Receiving objects: 22% (919/4174) Receiving objects: 23% (961/4174) Receiving objects: 24% (1002/4174) Receiving objects: 25% (1044/4174) Receiving objects: 26% (1086/4174) Receiving objects: 27% (1127/4174) Receiving objects: 28% (1169/4174) Receiving objects: 29% (1211/4174) Receiving objects: 30% (1253/4174) Receiving objects: 31% (1294/4174) Receiving objects: 32% (1336/4174) Receiving objects: 33% (1378/4174) Receiving objects: 34% (1420/4174) Receiving objects: 35% (1461/4174) Receiving objects: 36% (1503/4174) Receiving objects: 37% (1545/4174) Receiving objects: 38% (1587/4174) Receiving objects: 39% (1628/4174) Receiving objects: 40% (1670/4174) Receiving objects: 41% (1712/4174) Receiving objects: 42% (1754/4174) Receiving objects: 43% (1795/4174) Receiving objects: 44% (1837/4174) Receiving objects: 45% (1879/4174) Receiving objects: 46% (1921/4174) Receiving objects: 47% (1962/4174) Receiving objects: 48% (2004/4174) Receiving objects: 49% (2046/4174) Receiving objects: 50% (2087/4174) Receiving objects: 51% (2129/4174) Receiving objects: 52% (2171/4174) Receiving objects: 53% (2213/4174) Receiving objects: 54% (2254/4174) Receiving objects: 55% (2296/4174) Receiving objects: 56% (2338/4174) Receiving objects: 57% (2380/4174) Receiving objects: 58% (2421/4174) Receiving objects: 59% (2463/4174) Receiving objects: 60% (2505/4174) Receiving objects: 61% (2547/4174) Receiving objects: 62% (2588/4174) Receiving objects: 63% (2630/4174) Receiving objects: 64% (2672/4174) Receiving objects: 65% (2714/4174) Receiving objects: 66% (2755/4174) Receiving objects: 67% (2797/4174) Receiving objects: 68% (2839/4174) Receiving objects: 69% (2881/4174) Receiving objects: 70% (2922/4174) Receiving objects: 71% (2964/4174) Receiving objects: 72% (3006/4174) Receiving objects: 73% (3048/4174) Receiving objects: 74% (3089/4174) Receiving objects: 75% (3131/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 76% (3173/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 77% (3214/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 78% (3256/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 79% (3298/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 80% (3340/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 81% (3381/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 82% (3423/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 83% (3465/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 84% (3507/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 85% (3548/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 86% (3590/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 87% (3632/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 88% (3674/4174), 331.96 KiB | 637.00 KiB/s remote: Total 4174 (delta 1388), reused 1196 (delta 1196), pack-reused 2431
Receiving objects: 89% (3715/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 90% (3757/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 91% (3799/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 92% (3841/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 93% (3882/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 94% (3924/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 95% (3966/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 96% (4008/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 97% (4049/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 98% (4091/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 99% (4133/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 100% (4174/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 100% (4174/4174), 568.60 KiB | 637.00 KiB/s, done.
Resolving deltas: 0% (0/1505) Resolving deltas: 1% (19/1505) Resolving deltas: 2% (32/1505) Resolving deltas: 3% (46/1505) Resolving deltas: 4% (63/1505) Resolving deltas: 5% (81/1505) Resolving deltas: 6% (92/1505) Resolving deltas: 7% (107/1505) Resolving deltas: 8% (124/1505) Resolving deltas: 9% (143/1505) Resolving deltas: 12% (191/1505) Resolving deltas: 13% (198/1505) Resolving deltas: 15% (240/1505) Resolving deltas: 16% (253/1505) Resolving deltas: 18% (280/1505) Resolving deltas: 19% (288/1505) Resolving deltas: 20% (302/1505) Resolving deltas: 21% (327/1505) Resolving deltas: 22% (340/1505) Resolving deltas: 23% (358/1505) Resolving deltas: 24% (364/1505) Resolving deltas: 25% (378/1505) Resolving deltas: 26% (393/1505) Resolving deltas: 27% (410/1505) Resolving deltas: 28% (426/1505) Resolving deltas: 29% (441/1505) Resolving deltas: 30% (453/1505) Resolving deltas: 31% (469/1505) Resolving deltas: 32% (482/1505) Resolving deltas: 33% (501/1505) Resolving deltas: 34% (512/1505) Resolving deltas: 35% (528/1505) Resolving deltas: 36% (548/1505) Resolving deltas: 37% (563/1505) Resolving deltas: 39% (590/1505) Resolving deltas: 40% (608/1505) Resolving deltas: 41% (620/1505) Resolving deltas: 42% (634/1505) Resolving deltas: 43% (654/1505) Resolving deltas: 44% (664/1505) Resolving deltas: 45% (678/1505) Resolving deltas: 46% (694/1505) Resolving deltas: 47% (712/1505) Resolving deltas: 49% (740/1505) Resolving deltas: 50% (757/1505) Resolving deltas: 51% (768/1505) Resolving deltas: 52% (790/1505) Resolving deltas: 53% (804/1505) Resolving deltas: 54% (813/1505) Resolving deltas: 55% (829/1505) Resolving deltas: 56% (850/1505) Resolving deltas: 57% (858/1505) Resolving deltas: 58% (878/1505) Resolving deltas: 59% (888/1505) Resolving deltas: 60% (903/1505) Resolving deltas: 61% (919/1505) Resolving deltas: 62% (937/1505) Resolving deltas: 63% (949/1505) Resolving deltas: 64% (965/1505) Resolving deltas: 65% (980/1505) Resolving deltas: 66% (994/1505) Resolving deltas: 67% (1009/1505) Resolving deltas: 68% (1024/1505) Resolving deltas: 69% (1039/1505) Resolving deltas: 70% (1054/1505) Resolving deltas: 71% (1076/1505) Resolving deltas: 72% (1084/1505) Resolving deltas: 73% (1099/1505) Resolving deltas: 74% (1114/1505) Resolving deltas: 75% (1129/1505) Resolving deltas: 76% (1144/1505) Resolving deltas: 77% (1160/1505) Resolving deltas: 78% (1176/1505) Resolving deltas: 79% (1192/1505) Resolving deltas: 80% (1205/1505) Resolving deltas: 81% (1222/1505) Resolving deltas: 82% (1235/1505) Resolving deltas: 83% (1251/1505) Resolving deltas: 84% (1267/1505) Resolving deltas: 85% (1291/1505) Resolving deltas: 86% (1297/1505) Resolving deltas: 87% (1310/1505) Resolving deltas: 88% (1326/1505) Resolving deltas: 89% (1340/1505) Resolving deltas: 90% (1356/1505) Resolving deltas: 91% (1370/1505) Resolving deltas: 92% (1385/1505) Resolving deltas: 93% (1401/1505) Resolving deltas: 94% (1416/1505) Resolving deltas: 95% (1430/1505) Resolving deltas: 96% (1445/1505) Resolving deltas: 97% (1460/1505) Resolving deltas: 98% (1476/1505) Resolving deltas: 99% (1490/1505) Resolving deltas: 100% (1505/1505) Resolving deltas: 100% (1505/1505), completed with 529 local objects.
21a2b96..2f400e2 master -> origin/master
error: unable to resolve reference refs/remotes/origin/pr/1632/merge: No such file or directory
! 6443b71...9601ddc refs/pull/1632/merge -> origin/pr/1632/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1687/merge: No such file or directory
! 79b554b...bb1f7b1 refs/pull/1687/merge -> origin/pr/1687/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1725/merge: No such file or directory
! 32b0688...fa768f6 refs/pull/1725/merge -> origin/pr/1725/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1729/merge: No such file or directory
! f7d42fc...a1c35ff refs/pull/1729/merge -> origin/pr/1729/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1851/merge: No such file or directory
! 5ae11ca...e948acd refs/pull/1851/merge -> origin/pr/1851/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1898/merge: No such file or directory
! aa789ad...12d6897 refs/pull/1898/merge -> origin/pr/1898/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 06c9ea9...b3fc98c refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! 693c388...6232dd2 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2117/merge: No such file or directory
! 36e5d99...63e51d2 refs/pull/2117/merge -> origin/pr/2117/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! 2faf579...80566bf refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2167/merge: No such file or directory
! 2e6ccea...3afa157 refs/pull/2167/merge -> origin/pr/2167/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! 022ddfc...86b3f7d refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! b4fe6db...0af30a9 refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2239/merge: No such file or directory
! 6287975...b26429c refs/pull/2239/merge -> origin/pr/2239/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2242/merge: No such file or directory
! 93c7b85...be0f75a refs/pull/2242/merge -> origin/pr/2242/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2256/merge: No such file or directory
! 8eca896...f0c3182 refs/pull/2256/merge -> origin/pr/2256/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! f2dbc1d...c6a57dc refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 4cdcbec...b12a7a5 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! d2fedf2...2e4676e refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2305/merge: No such file or directory
! 34ec527...03cbf9b refs/pull/2305/merge -> origin/pr/2305/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2307/merge: No such file or directory
! 55c9ec6...662a8f2 refs/pull/2307/merge -> origin/pr/2307/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2310/merge: No such file or directory
! 91531bc...35d8095 refs/pull/2310/merge -> origin/pr/2310/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2315/merge: No such file or directory
! 67f684a...5e6087b refs/pull/2315/merge -> origin/pr/2315/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2323/merge: No such file or directory
! a24eec0...0698daa refs/pull/2323/merge -> origin/pr/2323/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 66f0342...08461a1 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! a2ada88...00175d7 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 24f7b87...6829e8e refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 15ba6f7...a88c6b1 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/merge: No such file or directory
! 2cc86f5...9c4a758 refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! bf31cf5...2f534a5 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! 4b7959a...a75f3b1 refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! e3e860b...356ed27 refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! e87a329...c43846c refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! bd76610...754d078 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 0106103...83f1610 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 272df41...fad0cc2 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 2b8decc...1f4bba2 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! 9e938d6...2341a96 refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 52c092d...55ee39c refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! e92fe53...af76f0b refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 263c128...8b033b5 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 1f805ec...1625a1c refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! aa94078...ba6b2d3 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! c9ac3b7...9364d32 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 2300f76...73f96ad refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 2df0127...d9434ad refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! 62fbb64...96ce1b5 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! ff75934...47d17e2 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! b49cc6c...6092c2f refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! b73aceb...a32caf8 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 9757aa5...1229edd refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! a484ab3...feffeba refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! d2990c2...9ebb97d refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 42f0cd3...2916983 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! f3100dd...3592759 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! 9c70d19...b318838 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! af6195b...7c50303 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2f400e2ac6e1375858d52ecd03af0993de13ad64 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2f400e2ac6e1375858d52ecd03af0993de13ad64
> git rev-list 21a2b96a1f617870aa5926d69878a72533ba259e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5911995645257953347.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6765133476494680153.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2264567051105139606.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5843306024050290123.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-13 18:02:48,121 6149143a MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/6149143a/pkb.log
2017-04-13 18:02:48,121 6149143a MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-13 18:02:48,121 6149143a MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-13 18:02:48,772 6149143a MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-13 18:02:48,894 6149143a MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-13 18:02:48,897 6149143a MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-13 18:02:48,897 6149143a MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-13 18:02:48,902 6149143a MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-13 18:02:48,904 6149143a MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-13 18:02:48,930 6149143a MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-13 18:02:48,931 6149143a MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/6149143a/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #303
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/303/display/redirect>
------------------------------------------
[...truncated 238.28 KB...]
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1363, done.
remote: Compressing objects: 0% (1/380) remote: Compressing objects: 1% (4/380) remote: Compressing objects: 2% (8/380) remote: Compressing objects: 3% (12/380) remote: Compressing objects: 4% (16/380) remote: Compressing objects: 5% (19/380) remote: Compressing objects: 6% (23/380) remote: Compressing objects: 7% (27/380) remote: Compressing objects: 8% (31/380) remote: Compressing objects: 9% (35/380) remote: Compressing objects: 10% (38/380) remote: Compressing objects: 11% (42/380) remote: Compressing objects: 12% (46/380) remote: Compressing objects: 13% (50/380) remote: Compressing objects: 14% (54/380) remote: Compressing objects: 15% (57/380) remote: Compressing objects: 16% (61/380) remote: Compressing objects: 17% (65/380) remote: Compressing objects: 18% (69/380) remote: Compressing objects: 19% (73/380) remote: Compressing objects: 20% (76/380) remote: Compressing objects: 21% (80/380) remote: Compressing objects: 22% (84/380) remote: Compressing objects: 23% (88/380) remote: Compressing objects: 24% (92/380) remote: Compressing objects: 25% (95/380) remote: Compressing objects: 26% (99/380) remote: Compressing objects: 27% (103/380) remote: Compressing objects: 28% (107/380) remote: Compressing objects: 29% (111/380) remote: Compressing objects: 30% (114/380) remote: Compressing objects: 31% (118/380) remote: Compressing objects: 32% (122/380) remote: Compressing objects: 33% (126/380) remote: Compressing objects: 34% (130/380) remote: Compressing objects: 35% (133/380) remote: Compressing objects: 36% (137/380) remote: Compressing objects: 37% (141/380) remote: Compressing objects: 38% (145/380) remote: Compressing objects: 39% (149/380) remote: Compressing objects: 40% (152/380) remote: Compressing objects: 41% (156/380) remote: Compressing objects: 42% (160/380) remote: Compressing objects: 43% (164/380) remote: Compressing objects: 44% (168/380) remote: Compressing objects: 45% (171/380) remote: Compressing objects: 46% (175/380) remote: Compressing objects: 47% (179/380) remote: Compressing objects: 48% (183/380) remote: Compressing objects: 49% (187/380) remote: Compressing objects: 50% (190/380) remote: Compressing objects: 51% (194/380) remote: Compressing objects: 52% (198/380) remote: Compressing objects: 53% (202/380) remote: Compressing objects: 54% (206/380) remote: Compressing objects: 55% (209/380) remote: Compressing objects: 56% (213/380) remote: Compressing objects: 57% (217/380) remote: Compressing objects: 58% (221/380) remote: Compressing objects: 59% (225/380) remote: Compressing objects: 60% (228/380) remote: Compressing objects: 61% (232/380) remote: Compressing objects: 62% (236/380) remote: Compressing objects: 63% (240/380) remote: Compressing objects: 64% (244/380) remote: Compressing objects: 65% (247/380) remote: Compressing objects: 66% (251/380) remote: Compressing objects: 67% (255/380) remote: Compressing objects: 68% (259/380) remote: Compressing objects: 69% (263/380) remote: Compressing objects: 70% (266/380) remote: Compressing objects: 71% (270/380) remote: Compressing objects: 72% (274/380) remote: Compressing objects: 73% (278/380) remote: Compressing objects: 74% (282/380) remote: Compressing objects: 75% (285/380) remote: Compressing objects: 76% (289/380) remote: Compressing objects: 77% (293/380) remote: Compressing objects: 78% (297/380) remote: Compressing objects: 79% (301/380) remote: Compressing objects: 80% (304/380) remote: Compressing objects: 81% (308/380) remote: Compressing objects: 82% (312/380) remote: Compressing objects: 83% (316/380) remote: Compressing objects: 84% (320/380) remote: Compressing objects: 85% (323/380) remote: Compressing objects: 86% (327/380) remote: Compressing objects: 87% (331/380) remote: Compressing objects: 88% (335/380) remote: Compressing objects: 89% (339/380) remote: Compressing objects: 90% (342/380) remote: Compressing objects: 91% (346/380) remote: Compressing objects: 92% (350/380) remote: Compressing objects: 93% (354/380) remote: Compressing objects: 94% (358/380) remote: Compressing objects: 95% (361/380) remote: Compressing objects: 96% (365/380) remote: Compressing objects: 97% (369/380) remote: Compressing objects: 98% (373/380) remote: Compressing objects: 99% (377/380) remote: Compressing objects: 100% (380/380) remote: Compressing objects: 100% (380/380), done.
Receiving objects: 0% (1/1363) Receiving objects: 1% (14/1363) Receiving objects: 2% (28/1363) Receiving objects: 3% (41/1363) Receiving objects: 4% (55/1363) Receiving objects: 5% (69/1363) Receiving objects: 6% (82/1363) Receiving objects: 7% (96/1363) Receiving objects: 8% (110/1363) Receiving objects: 9% (123/1363) Receiving objects: 10% (137/1363) Receiving objects: 11% (150/1363) Receiving objects: 12% (164/1363) Receiving objects: 13% (178/1363) Receiving objects: 14% (191/1363) Receiving objects: 15% (205/1363) Receiving objects: 16% (219/1363) Receiving objects: 17% (232/1363) Receiving objects: 18% (246/1363) Receiving objects: 19% (259/1363) Receiving objects: 20% (273/1363) Receiving objects: 21% (287/1363) Receiving objects: 22% (300/1363) Receiving objects: 23% (314/1363) Receiving objects: 24% (328/1363) Receiving objects: 25% (341/1363) Receiving objects: 26% (355/1363) Receiving objects: 27% (369/1363) Receiving objects: 28% (382/1363) Receiving objects: 29% (396/1363) Receiving objects: 30% (409/1363) Receiving objects: 31% (423/1363) Receiving objects: 32% (437/1363) Receiving objects: 33% (450/1363) Receiving objects: 34% (464/1363) Receiving objects: 35% (478/1363) Receiving objects: 36% (491/1363) Receiving objects: 37% (505/1363) Receiving objects: 38% (518/1363) Receiving objects: 39% (532/1363) Receiving objects: 40% (546/1363) Receiving objects: 41% (559/1363) Receiving objects: 42% (573/1363) Receiving objects: 43% (587/1363) Receiving objects: 44% (600/1363) Receiving objects: 45% (614/1363) Receiving objects: 46% (627/1363) Receiving objects: 47% (641/1363) Receiving objects: 48% (655/1363) Receiving objects: 49% (668/1363) Receiving objects: 50% (682/1363) Receiving objects: 51% (696/1363) Receiving objects: 52% (709/1363) Receiving objects: 53% (723/1363) Receiving objects: 54% (737/1363) Receiving objects: 55% (750/1363) Receiving objects: 56% (764/1363) Receiving objects: 57% (777/1363) Receiving objects: 58% (791/1363) Receiving objects: 59% (805/1363) Receiving objects: 60% (818/1363) Receiving objects: 61% (832/1363) Receiving objects: 62% (846/1363) Receiving objects: 63% (859/1363) Receiving objects: 64% (873/1363) Receiving objects: 65% (886/1363) Receiving objects: 66% (900/1363) Receiving objects: 67% (914/1363) Receiving objects: 68% (927/1363) Receiving objects: 69% (941/1363) Receiving objects: 70% (955/1363) Receiving objects: 71% (968/1363) Receiving objects: 72% (982/1363) Receiving objects: 73% (995/1363) Receiving objects: 74% (1009/1363) Receiving objects: 75% (1023/1363) Receiving objects: 76% (1036/1363) Receiving objects: 77% (1050/1363) remote: Total 1363 (delta 412), reused 296 (delta 296), pack-reused 362
Receiving objects: 78% (1064/1363) Receiving objects: 79% (1077/1363) Receiving objects: 80% (1091/1363) Receiving objects: 81% (1105/1363) Receiving objects: 82% (1118/1363) Receiving objects: 83% (1132/1363) Receiving objects: 84% (1145/1363) Receiving objects: 85% (1159/1363) Receiving objects: 86% (1173/1363) Receiving objects: 87% (1186/1363) Receiving objects: 88% (1200/1363) Receiving objects: 89% (1214/1363) Receiving objects: 90% (1227/1363) Receiving objects: 91% (1241/1363) Receiving objects: 92% (1254/1363) Receiving objects: 93% (1268/1363) Receiving objects: 94% (1282/1363) Receiving objects: 95% (1295/1363) Receiving objects: 96% (1309/1363) Receiving objects: 97% (1323/1363) Receiving objects: 98% (1336/1363) Receiving objects: 99% (1350/1363) Receiving objects: 100% (1363/1363) Receiving objects: 100% (1363/1363), 438.77 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/419) Resolving deltas: 1% (5/419) Resolving deltas: 3% (15/419) Resolving deltas: 6% (28/419) Resolving deltas: 8% (34/419) Resolving deltas: 9% (40/419) Resolving deltas: 11% (49/419) Resolving deltas: 13% (56/419) Resolving deltas: 14% (59/419) Resolving deltas: 18% (76/419) Resolving deltas: 19% (82/419) Resolving deltas: 20% (85/419) Resolving deltas: 22% (94/419) Resolving deltas: 23% (97/419) Resolving deltas: 24% (101/419) Resolving deltas: 25% (105/419) Resolving deltas: 26% (110/419) Resolving deltas: 27% (116/419) Resolving deltas: 28% (118/419) Resolving deltas: 29% (125/419) Resolving deltas: 30% (126/419) Resolving deltas: 31% (130/419) Resolving deltas: 32% (135/419) Resolving deltas: 34% (144/419) Resolving deltas: 36% (152/419) Resolving deltas: 37% (158/419) Resolving deltas: 38% (160/419) Resolving deltas: 39% (164/419) Resolving deltas: 40% (168/419) Resolving deltas: 41% (172/419) Resolving deltas: 42% (177/419) Resolving deltas: 43% (181/419) Resolving deltas: 44% (185/419) Resolving deltas: 45% (189/419) Resolving deltas: 46% (194/419) Resolving deltas: 47% (197/419) Resolving deltas: 48% (202/419) Resolving deltas: 49% (207/419) Resolving deltas: 50% (210/419) Resolving deltas: 51% (214/419) Resolving deltas: 52% (218/419) Resolving deltas: 53% (223/419) Resolving deltas: 54% (228/419) Resolving deltas: 55% (233/419) Resolving deltas: 59% (249/419) Resolving deltas: 60% (254/419) Resolving deltas: 61% (257/419) Resolving deltas: 62% (260/419) Resolving deltas: 63% (264/419) Resolving deltas: 64% (269/419) Resolving deltas: 65% (274/419) Resolving deltas: 66% (277/419) Resolving deltas: 67% (282/419) Resolving deltas: 68% (286/419) Resolving deltas: 69% (291/419) Resolving deltas: 70% (294/419) Resolving deltas: 71% (298/419) Resolving deltas: 72% (303/419) Resolving deltas: 73% (307/419) Resolving deltas: 74% (312/419) Resolving deltas: 75% (315/419) Resolving deltas: 76% (319/419) Resolving deltas: 77% (323/419) Resolving deltas: 78% (327/419) Resolving deltas: 79% (332/419) Resolving deltas: 80% (336/419) Resolving deltas: 81% (341/419) Resolving deltas: 82% (346/419) Resolving deltas: 83% (348/419) Resolving deltas: 84% (353/419) Resolving deltas: 85% (357/419) Resolving deltas: 86% (361/419) Resolving deltas: 87% (365/419) Resolving deltas: 88% (369/419) Resolving deltas: 89% (373/419) Resolving deltas: 90% (378/419) Resolving deltas: 91% (382/419) Resolving deltas: 92% (386/419) Resolving deltas: 93% (390/419) Resolving deltas: 94% (394/419) Resolving deltas: 95% (399/419) Resolving deltas: 96% (404/419) Resolving deltas: 97% (407/419) Resolving deltas: 98% (412/419) Resolving deltas: 99% (415/419) Resolving deltas: 100% (419/419) Resolving deltas: 100% (419/419), completed with 177 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2312/merge: No such file or directory
! 1291190...e94139f refs/pull/2312/merge -> origin/pr/2312/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2326/merge: No such file or directory
! 610eaa2...86d0009 refs/pull/2326/merge -> origin/pr/2326/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2329/merge: No such file or directory
! 20bbf13...fa2aa3b refs/pull/2329/merge -> origin/pr/2329/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/head: No such file or directory
! b4ce660...447fcc4 refs/pull/2401/head -> origin/pr/2401/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 1452f9c...bd76610 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! 921d0d1...ccb8287 refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! 64e410f...19fe331 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! 3b3df77...edf10d8 refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 2036ad8...e410b62 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! fca83db...21442f4 refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2437/merge: No such file or directory
! 7b0eafc...53d38b6 refs/pull/2437/merge -> origin/pr/2437/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! 9dd01c0...3d9e766 refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! bb0ba54...f7cf9e0 refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2441/merge: No such file or directory
! 3b60b91...d341a1b refs/pull/2441/merge -> origin/pr/2441/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2444/merge: No such file or directory
! b597f15...0fa0ac3 refs/pull/2444/merge -> origin/pr/2444/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2446/merge: No such file or directory
! 726d395...d8e68e0 refs/pull/2446/merge -> origin/pr/2446/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! 812ab1b...dd3a255 refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2451/merge: No such file or directory
! 04ed807...2556b0c refs/pull/2451/merge -> origin/pr/2451/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 770fdf9...13271e4 refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2454/merge: No such file or directory
! 5070afd...ebc1fcb refs/pull/2454/merge -> origin/pr/2454/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 3eb6981...c0618d2 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2461/merge: No such file or directory
! a469025...6555c33 refs/pull/2461/merge -> origin/pr/2461/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2463/merge: No such file or directory
! b5859a0...d8e1697 refs/pull/2463/merge -> origin/pr/2463/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2464/merge: No such file or directory
! d925561...e9ece7e refs/pull/2464/merge -> origin/pr/2464/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2465/merge: No such file or directory
! a95f45f...e5301bd refs/pull/2465/merge -> origin/pr/2465/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2466/merge: No such file or directory
! 64c1789...ecbddae refs/pull/2466/merge -> origin/pr/2466/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2467/merge: No such file or directory
! f59cdb3...3a6875d refs/pull/2467/merge -> origin/pr/2467/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2472/merge: No such file or directory
! c878ae3...831b2ca refs/pull/2472/merge -> origin/pr/2472/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! 24521dd...178a986 refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2475/merge: No such file or directory
! d2e8f53...fd356cf refs/pull/2475/merge -> origin/pr/2475/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2477/merge: No such file or directory
! 0e438cb...2de0590 refs/pull/2477/merge -> origin/pr/2477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2480/merge: No such file or directory
! d77124c...25129aa refs/pull/2480/merge -> origin/pr/2480/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 3093a87...9c47b5c refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! 09c1616...46abcbb refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! 53d4db7...9c11f1a refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2490/merge: No such file or directory
! 88d7cb3...3105f5b refs/pull/2490/merge -> origin/pr/2490/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2492/merge: No such file or directory
! a5842c1...25853db refs/pull/2492/merge -> origin/pr/2492/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! ed1bdd7...e5c16ef refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 53d45f9...7824d0b refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! a918d52...9b1a760 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! b83f68f...c20b9a6 refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 30f3087...b62e07f refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 6d5cee9...44217fd refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! 80646ec...b7373ee refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2513/merge: No such file or directory
! ac43e77...dede701 refs/pull/2513/merge -> origin/pr/2513/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 0f55903...6b345b9 refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 21a2b96a1f617870aa5926d69878a72533ba259e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 21a2b96a1f617870aa5926d69878a72533ba259e
> git rev-list 21a2b96a1f617870aa5926d69878a72533ba259e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5628607114048440720.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3864351552237230459.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2261432327707514885.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8328633429678672246.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-13 12:02:40,924 3cd68526 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3cd68526/pkb.log
2017-04-13 12:02:40,924 3cd68526 MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-13 12:02:40,925 3cd68526 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-13 12:02:41,290 3cd68526 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-13 12:02:41,376 3cd68526 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-13 12:02:41,378 3cd68526 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-13 12:02:41,378 3cd68526 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-13 12:02:41,384 3cd68526 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-13 12:02:41,386 3cd68526 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-13 12:02:41,409 3cd68526 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-13 12:02:41,409 3cd68526 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3cd68526/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #302
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/302/display/redirect?page=changes>
Changes:
[aviemzur] [BEAM-1950] Add missing 'static' keyword to
------------------------------------------
[...truncated 254.45 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 20d7d5b...06c9ea9 refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! fd98fa0...693c388 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2143/merge: No such file or directory
! 78aa347...4684695 refs/pull/2143/merge -> origin/pr/2143/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2146/merge: No such file or directory
! 4223a37...db88f4f refs/pull/2146/merge -> origin/pr/2146/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! 6745140...2faf579 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! f927ea9...022ddfc refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! 9242e99...b4fe6db refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! f33b9d1...f2dbc1d refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 0ad27c9...4cdcbec refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2275/merge: No such file or directory
! bf81970...b4a9a27 refs/pull/2275/merge -> origin/pr/2275/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 382d2d8...d2fedf2 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2289/merge: No such file or directory
! dfcd0a6...f2cd85f refs/pull/2289/merge -> origin/pr/2289/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2294/merge: No such file or directory
! a81bc0a...316c95d refs/pull/2294/merge -> origin/pr/2294/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 22e4ca8...66f0342 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 1ca2d90...a2ada88 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! cc88fa4...24f7b87 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! f43369f...15ba6f7 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2351/merge: No such file or directory
! 1258b0e...c052529 refs/pull/2351/merge -> origin/pr/2351/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 4d6ae2a...bf31cf5 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2375/merge: No such file or directory
! 2ec3dd2...6b2cff9 refs/pull/2375/merge -> origin/pr/2375/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 042f3f8...241ec60 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 4ef3b41...1452f9c refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 739b410...0106103 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 8c5865c...272df41 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! a9b1918...2b8decc refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 350c2b7...e92fe53 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2437/merge: No such file or directory
! 27bfed9...7b0eafc refs/pull/2437/merge -> origin/pr/2437/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! aa9935a...263c128 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2446/merge: No such file or directory
! b652cd5...726d395 refs/pull/2446/merge -> origin/pr/2446/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 393fdff...3eb6981 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 3f0a55f...1f805ec refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! f1aef15...aa94078 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2461/merge: No such file or directory
! 8297c69...a469025 refs/pull/2461/merge -> origin/pr/2461/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! a9628c6...c9ac3b7 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 2fe1399...2300f76 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2480/merge: No such file or directory
! 8b5772f...d77124c refs/pull/2480/merge -> origin/pr/2480/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 70794be...2df0127 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! d97be9c...3093a87 refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! 1befd55...09c1616 refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! 646ddc5...62fbb64 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! 34ce32c...ff75934 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! 9050714...53d4db7 refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2490/merge: No such file or directory
! 217999c...88d7cb3 refs/pull/2490/merge -> origin/pr/2490/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! 0915262...ed1bdd7 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! b55a0cb...53d45f9 refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! c93e7fe...a918d52 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! f663556...b49cc6c refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! a766154...b73aceb refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 5555365...30f3087 refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! e5eacbe...9757aa5 refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! 5a729dd...a484ab3 refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! a0fbd64...d2990c2 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! b7b5933...42f0cd3 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! fa95fd3...f3100dd refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 3b15fe0...6d5cee9 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! 5800ae6...80646ec refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! dce5a00...9c70d19 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! ee00648...5a1ef91 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! a17eded...0f55903 refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
error: unable to resolve reference refs/remotes/origin/pr/284/merge: No such file or directory
! 7cec9f3...5d30780 refs/pull/284/merge -> origin/pr/284/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 0121978...af6195b refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 21a2b96a1f617870aa5926d69878a72533ba259e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 21a2b96a1f617870aa5926d69878a72533ba259e
> git rev-list dc672f42083c375872d87030523545866cea4f55 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson256315355149481464.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5948459804827245964.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4415092307348827806.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2463206724745091241.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-13 06:02:09,916 f84b94da MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/f84b94da/pkb.log
2017-04-13 06:02:09,917 f84b94da MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-13 06:02:09,917 f84b94da MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-13 06:02:10,099 f84b94da MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-13 06:02:10,182 f84b94da MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-13 06:02:10,185 f84b94da MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-13 06:02:10,185 f84b94da MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-13 06:02:10,190 f84b94da MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-13 06:02:10,192 f84b94da MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-13 06:02:10,217 f84b94da MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-13 06:02:10,217 f84b94da MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/f84b94da/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #301
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/301/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-1882] Update postgres k8 scripts & add scripts for running local
[kirpichov] Removes MapElements.MissingOutputTypeDescriptor
[kirpichov] Removes FlatMapElements.MissingOutputTypeDescriptor
[altay] Revert "Throw specialized exception in value providers"
[altay] Revert "Revert "Revert "Add ValueProvider class for FileBasedSource I/O
[jbonofre] [BEAM-911] Mark IO APIs as @Experimental
[tgroh] Move travis/jenkins folders in a test-infra folder
[tgroh] Move jdbc's postgres k8s scripts into shared k8s dir
[tgroh] Move HIFIO k8s scripts into shared dir
[chamikara] [BEAM-1222] Chunk size should be FS dependent
[dhalperi] Move Triggers from sdk-core to runners-core-construction
------------------------------------------
[...truncated 259.95 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2363/head: No such file or directory
! 3e3557b...831b11f refs/pull/2363/head -> origin/pr/2363/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! 5c504b9...4b7959a refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! fc1ce54...e3e860b refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! bb3a0bf...e87a329 refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 2bf744d...4ef3b41 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 6f0fe1f...739b410 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2407/merge: No such file or directory
! 928d4e7...62ddf5b refs/pull/2407/merge -> origin/pr/2407/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2412/merge: No such file or directory
! 4e09b85...8d36b9c refs/pull/2412/merge -> origin/pr/2412/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! b3f7127...ddb1eb9 refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 3b173fd...8c5865c refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2418/merge: No such file or directory
! bef3e4e...d2b960f refs/pull/2418/merge -> origin/pr/2418/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! d053379...a9b1918 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 6baf9d9...52c092d refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 363e746...350c2b7 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! c6e1cd4...921d0d1 refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! d82087d...64e410f refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 031eb80...cabd191 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! dea7fc9...2036ad8 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! cd67231...fca83db refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! f769f23...9dd01c0 refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! 1071e10...bb0ba54 refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! a581a04...aa9935a refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! 7709d38...812ab1b refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 34949af...770fdf9 refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 205d344...3f0a55f refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! 0a93f40...f1aef15 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2463/merge: No such file or directory
! 0d28f97...b5859a0 refs/pull/2463/merge -> origin/pr/2463/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2465/merge: No such file or directory
! da67e19...a95f45f refs/pull/2465/merge -> origin/pr/2465/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2466/head: No such file or directory
! d098fbf...ad8ee8b refs/pull/2466/head -> origin/pr/2466/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2466/merge: No such file or directory
! e39cf48...64c1789 refs/pull/2466/merge -> origin/pr/2466/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 74ce4fe...a9628c6 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2475/merge: No such file or directory
! 4932314...d2e8f53 refs/pull/2475/merge -> origin/pr/2475/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 5820b39...2fe1399 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2477/merge: No such file or directory
! cd45d9c...0e438cb refs/pull/2477/merge -> origin/pr/2477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2479/merge: No such file or directory
! 7cd8458...b74b79c refs/pull/2479/merge -> origin/pr/2479/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2480/merge: No such file or directory
! da4061b...8b5772f refs/pull/2480/merge -> origin/pr/2480/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 141c777...70794be refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 77eb628...d97be9c refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! 8ae2784...1befd55 refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! c6087e0...646ddc5 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! a3748bb...34ce32c refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! c241c76...9050714 refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2490/merge: No such file or directory
! 0991abb...217999c refs/pull/2490/merge -> origin/pr/2490/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2492/merge: No such file or directory
! 7dc5d6b...a5842c1 refs/pull/2492/merge -> origin/pr/2492/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! e4e972f...0915262 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 9ec2288...b55a0cb refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! d81656f...c93e7fe refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! 0e95aea...b83f68f refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! 49f46a4...f663556 refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! 4182356...a766154 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 56a66e6...5555365 refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 97e38ea...e5eacbe refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! ee63e1b...5a729dd refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 2784e86...a0fbd64 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 0e4277f...b7b5933 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 04f3604...fa95fd3 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! bfca794...3b15fe0 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! 82ccd8d...5800ae6 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/head: No such file or directory
! 039b399..1ab6a9a refs/pull/2512/head -> origin/pr/2512/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! f0412ee...dce5a00 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2513/head: No such file or directory
! 6d04461..0afd8c4 refs/pull/2513/head -> origin/pr/2513/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2513/merge: No such file or directory
! f96a72f...ac43e77 refs/pull/2513/merge -> origin/pr/2513/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! d1e921c...ee00648 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! d3b3dcf...a17eded refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 943af0b...0121978 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision dc672f42083c375872d87030523545866cea4f55 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f dc672f42083c375872d87030523545866cea4f55
> git rev-list 435c3b4267f527543849db3777f021fecc5964df # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5507781482767896631.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8061654862004744830.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3339859183906304130.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7913208134909788415.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-13 00:02:44,068 30f016fd MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/30f016fd/pkb.log
2017-04-13 00:02:44,068 30f016fd MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-13 00:02:44,068 30f016fd MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-13 00:02:44,737 30f016fd MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-13 00:02:44,824 30f016fd MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-13 00:02:44,826 30f016fd MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-13 00:02:44,827 30f016fd MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-13 00:02:44,831 30f016fd MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-13 00:02:44,833 30f016fd MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-13 00:02:44,859 30f016fd MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-13 00:02:44,859 30f016fd MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/30f016fd/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #300
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/300/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-1722] Move PubsubIO into the google-cloud-platform module
[dhalperi] Use SdkComponents in WindowingStrategy.toProto
[lcwik] [BEAM-115] Update timer/state fields on ParDoPayload to use a map field
------------------------------------------
[...truncated 224.76 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 435c3b4267f527543849db3777f021fecc5964df (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 435c3b4267f527543849db3777f021fecc5964df
> git rev-list 82f2f2cff0f026800df465f1bff5451a7891ee13 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6754799537072330658.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2785449504838958491.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5038314372399967154.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2537669270750140512.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-12 18:05:58,376 93edaa3f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/93edaa3f/pkb.log
2017-04-12 18:05:58,377 93edaa3f MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-12 18:05:58,380 93edaa3f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-12 18:05:58,809 93edaa3f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-12 18:05:59,016 93edaa3f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-12 18:05:59,022 93edaa3f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-12 18:05:59,023 93edaa3f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-12 18:05:59,036 93edaa3f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-12 18:05:59,041 93edaa3f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-12 18:05:59,066 93edaa3f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-12 18:05:59,067 93edaa3f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/93edaa3f/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #299
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/299/display/redirect>
------------------------------------------
[...truncated 231.87 KB...]
remote: Counting objects: 3096, done.
remote: Compressing objects: 0% (1/177) remote: Compressing objects: 1% (2/177) remote: Compressing objects: 2% (4/177) remote: Compressing objects: 3% (6/177) remote: Compressing objects: 4% (8/177) remote: Compressing objects: 5% (9/177) remote: Compressing objects: 6% (11/177) remote: Compressing objects: 7% (13/177) remote: Compressing objects: 8% (15/177) remote: Compressing objects: 9% (16/177) remote: Compressing objects: 10% (18/177) remote: Compressing objects: 11% (20/177) remote: Compressing objects: 12% (22/177) remote: Compressing objects: 13% (24/177) remote: Compressing objects: 14% (25/177) remote: Compressing objects: 15% (27/177) remote: Compressing objects: 16% (29/177) remote: Compressing objects: 17% (31/177) remote: Compressing objects: 18% (32/177) remote: Compressing objects: 19% (34/177) remote: Compressing objects: 20% (36/177) remote: Compressing objects: 21% (38/177) remote: Compressing objects: 22% (39/177) remote: Compressing objects: 23% (41/177) remote: Compressing objects: 24% (43/177) remote: Compressing objects: 25% (45/177) remote: Compressing objects: 26% (47/177) remote: Compressing objects: 27% (48/177) remote: Compressing objects: 28% (50/177) remote: Compressing objects: 29% (52/177) remote: Compressing objects: 30% (54/177) remote: Compressing objects: 31% (55/177) remote: Compressing objects: 32% (57/177) remote: Compressing objects: 33% (59/177) remote: Compressing objects: 34% (61/177) remote: Compressing objects: 35% (62/177) remote: Compressing objects: 36% (64/177) remote: Compressing objects: 37% (66/177) remote: Compressing objects: 38% (68/177) remote: Compressing objects: 39% (70/177) remote: Compressing objects: 40% (71/177) remote: Compressing objects: 41% (73/177) remote: Compressing objects: 42% (75/177) remote: Compressing objects: 43% (77/177) remote: Compressing objects: 44% (78/177) remote: Compressing objects: 45% (80/177) remote: Compressing objects: 46% (82/177) remote: Compressing objects: 47% (84/177) remote: Compressing objects: 48% (85/177) remote: Compressing objects: 49% (87/177) remote: Compressing objects: 50% (89/177) remote: Compressing objects: 51% (91/177) remote: Compressing objects: 52% (93/177) remote: Compressing objects: 53% (94/177) remote: Compressing objects: 54% (96/177) remote: Compressing objects: 55% (98/177) remote: Compressing objects: 56% (100/177) remote: Compressing objects: 57% (101/177) remote: Compressing objects: 58% (103/177) remote: Compressing objects: 59% (105/177) remote: Compressing objects: 60% (107/177) remote: Compressing objects: 61% (108/177) remote: Compressing objects: 62% (110/177) remote: Compressing objects: 63% (112/177) remote: Compressing objects: 64% (114/177) remote: Compressing objects: 65% (116/177) remote: Compressing objects: 66% (117/177) remote: Compressing objects: 67% (119/177) remote: Compressing objects: 68% (121/177) remote: Compressing objects: 69% (123/177) remote: Compressing objects: 70% (124/177) remote: Compressing objects: 71% (126/177) remote: Compressing objects: 72% (128/177) remote: Compressing objects: 73% (130/177) remote: Compressing objects: 74% (131/177) remote: Compressing objects: 75% (133/177) remote: Compressing objects: 76% (135/177) remote: Compressing objects: 77% (137/177) remote: Compressing objects: 78% (139/177) remote: Compressing objects: 79% (140/177) remote: Compressing objects: 80% (142/177) remote: Compressing objects: 81% (144/177) remote: Compressing objects: 82% (146/177) remote: Compressing objects: 83% (147/177) remote: Compressing objects: 84% (149/177) remote: Compressing objects: 85% (151/177) remote: Compressing objects: 86% (153/177) remote: Compressing objects: 87% (154/177) remote: Compressing objects: 88% (156/177) remote: Compressing objects: 89% (158/177) remote: Compressing objects: 90% (160/177) remote: Compressing objects: 91% (162/177) remote: Compressing objects: 92% (163/177) remote: Compressing objects: 93% (165/177) remote: Compressing objects: 94% (167/177) remote: Compressing objects: 95% (169/177) remote: Compressing objects: 96% (170/177) remote: Compressing objects: 97% (172/177) remote: Compressing objects: 98% (174/177) remote: Compressing objects: 99% (176/177) remote: Compressing objects: 100% (177/177) remote: Compressing objects: 100% (177/177), done.
Receiving objects: 0% (1/3096) Receiving objects: 1% (31/3096) Receiving objects: 2% (62/3096) Receiving objects: 3% (93/3096) Receiving objects: 4% (124/3096) Receiving objects: 5% (155/3096) Receiving objects: 6% (186/3096) Receiving objects: 7% (217/3096) Receiving objects: 8% (248/3096) Receiving objects: 9% (279/3096) Receiving objects: 10% (310/3096) Receiving objects: 11% (341/3096) Receiving objects: 12% (372/3096) Receiving objects: 13% (403/3096) Receiving objects: 14% (434/3096) Receiving objects: 15% (465/3096) Receiving objects: 16% (496/3096) Receiving objects: 17% (527/3096) Receiving objects: 18% (558/3096) Receiving objects: 19% (589/3096) Receiving objects: 20% (620/3096) Receiving objects: 21% (651/3096) Receiving objects: 22% (682/3096) Receiving objects: 23% (713/3096) Receiving objects: 24% (744/3096) Receiving objects: 25% (774/3096) Receiving objects: 26% (805/3096) Receiving objects: 27% (836/3096) Receiving objects: 28% (867/3096) Receiving objects: 29% (898/3096) Receiving objects: 30% (929/3096) Receiving objects: 31% (960/3096) Receiving objects: 32% (991/3096) Receiving objects: 33% (1022/3096) Receiving objects: 34% (1053/3096) Receiving objects: 35% (1084/3096) Receiving objects: 36% (1115/3096) Receiving objects: 37% (1146/3096) Receiving objects: 38% (1177/3096) Receiving objects: 39% (1208/3096) Receiving objects: 40% (1239/3096) Receiving objects: 41% (1270/3096) Receiving objects: 42% (1301/3096) Receiving objects: 43% (1332/3096) Receiving objects: 44% (1363/3096) Receiving objects: 45% (1394/3096) Receiving objects: 46% (1425/3096) Receiving objects: 47% (1456/3096) Receiving objects: 48% (1487/3096) Receiving objects: 49% (1518/3096) Receiving objects: 50% (1548/3096) Receiving objects: 51% (1579/3096) Receiving objects: 52% (1610/3096) Receiving objects: 53% (1641/3096) Receiving objects: 54% (1672/3096) Receiving objects: 55% (1703/3096) Receiving objects: 56% (1734/3096) Receiving objects: 57% (1765/3096) Receiving objects: 58% (1796/3096) Receiving objects: 59% (1827/3096) Receiving objects: 60% (1858/3096) Receiving objects: 61% (1889/3096) Receiving objects: 62% (1920/3096) Receiving objects: 63% (1951/3096) Receiving objects: 64% (1982/3096) Receiving objects: 65% (2013/3096) Receiving objects: 66% (2044/3096) Receiving objects: 67% (2075/3096) Receiving objects: 68% (2106/3096) Receiving objects: 69% (2137/3096) Receiving objects: 70% (2168/3096) Receiving objects: 71% (2199/3096) Receiving objects: 72% (2230/3096) Receiving objects: 73% (2261/3096) Receiving objects: 74% (2292/3096) Receiving objects: 75% (2322/3096) Receiving objects: 76% (2353/3096) Receiving objects: 77% (2384/3096) Receiving objects: 78% (2415/3096) Receiving objects: 79% (2446/3096) Receiving objects: 80% (2477/3096) Receiving objects: 81% (2508/3096) Receiving objects: 82% (2539/3096) Receiving objects: 83% (2570/3096) Receiving objects: 84% (2601/3096) Receiving objects: 85% (2632/3096) Receiving objects: 86% (2663/3096) Receiving objects: 87% (2694/3096) Receiving objects: 88% (2725/3096) Receiving objects: 89% (2756/3096) Receiving objects: 90% (2787/3096) Receiving objects: 91% (2818/3096) Receiving objects: 92% (2849/3096) Receiving objects: 93% (2880/3096) remote: Total 3096 (delta 935), reused 860 (delta 860), pack-reused 2000
Receiving objects: 94% (2911/3096) Receiving objects: 95% (2942/3096) Receiving objects: 96% (2973/3096) Receiving objects: 97% (3004/3096) Receiving objects: 98% (3035/3096) Receiving objects: 99% (3066/3096) Receiving objects: 100% (3096/3096) Receiving objects: 100% (3096/3096), 483.98 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/1292) Resolving deltas: 1% (15/1292) Resolving deltas: 2% (26/1292) Resolving deltas: 3% (39/1292) Resolving deltas: 4% (53/1292) Resolving deltas: 5% (71/1292) Resolving deltas: 6% (78/1292) Resolving deltas: 8% (104/1292) Resolving deltas: 9% (123/1292) Resolving deltas: 10% (131/1292) Resolving deltas: 11% (144/1292) Resolving deltas: 13% (172/1292) Resolving deltas: 14% (185/1292) Resolving deltas: 16% (212/1292) Resolving deltas: 17% (220/1292) Resolving deltas: 18% (234/1292) Resolving deltas: 20% (259/1292) Resolving deltas: 21% (273/1292) Resolving deltas: 22% (297/1292) Resolving deltas: 23% (299/1292) Resolving deltas: 24% (313/1292) Resolving deltas: 25% (324/1292) Resolving deltas: 26% (338/1292) Resolving deltas: 27% (352/1292) Resolving deltas: 28% (364/1292) Resolving deltas: 29% (376/1292) Resolving deltas: 30% (388/1292) Resolving deltas: 32% (424/1292) Resolving deltas: 33% (433/1292) Resolving deltas: 34% (440/1292) Resolving deltas: 35% (457/1292) Resolving deltas: 36% (469/1292) Resolving deltas: 37% (479/1292) Resolving deltas: 38% (494/1292) Resolving deltas: 39% (511/1292) Resolving deltas: 40% (524/1292) Resolving deltas: 41% (530/1292) Resolving deltas: 43% (556/1292) Resolving deltas: 44% (571/1292) Resolving deltas: 45% (584/1292) Resolving deltas: 46% (595/1292) Resolving deltas: 47% (612/1292) Resolving deltas: 48% (622/1292) Resolving deltas: 49% (635/1292) Resolving deltas: 50% (648/1292) Resolving deltas: 51% (661/1292) Resolving deltas: 52% (672/1292) Resolving deltas: 53% (685/1292) Resolving deltas: 54% (698/1292) Resolving deltas: 55% (713/1292) Resolving deltas: 56% (724/1292) Resolving deltas: 57% (738/1292) Resolving deltas: 58% (754/1292) Resolving deltas: 59% (764/1292) Resolving deltas: 60% (776/1292) Resolving deltas: 61% (789/1292) Resolving deltas: 62% (806/1292) Resolving deltas: 63% (814/1292) Resolving deltas: 64% (828/1292) Resolving deltas: 65% (840/1292) Resolving deltas: 66% (854/1292) Resolving deltas: 67% (868/1292) Resolving deltas: 68% (879/1292) Resolving deltas: 69% (892/1292) Resolving deltas: 70% (906/1292) Resolving deltas: 71% (922/1292) Resolving deltas: 72% (931/1292) Resolving deltas: 73% (944/1292) Resolving deltas: 74% (959/1292) Resolving deltas: 75% (976/1292) Resolving deltas: 76% (982/1292) Resolving deltas: 77% (995/1292) Resolving deltas: 78% (1008/1292) Resolving deltas: 79% (1021/1292) Resolving deltas: 80% (1036/1292) Resolving deltas: 81% (1053/1292) Resolving deltas: 82% (1060/1292) Resolving deltas: 83% (1073/1292) Resolving deltas: 84% (1087/1292) Resolving deltas: 85% (1099/1292) Resolving deltas: 86% (1112/1292) Resolving deltas: 87% (1126/1292) Resolving deltas: 88% (1137/1292) Resolving deltas: 89% (1150/1292) Resolving deltas: 90% (1165/1292) Resolving deltas: 91% (1179/1292) Resolving deltas: 92% (1190/1292) Resolving deltas: 93% (1202/1292) Resolving deltas: 94% (1216/1292) Resolving deltas: 95% (1228/1292) Resolving deltas: 96% (1241/1292) Resolving deltas: 97% (1254/1292) Resolving deltas: 98% (1268/1292) Resolving deltas: 99% (1284/1292) Resolving deltas: 100% (1292/1292) Resolving deltas: 100% (1292/1292), completed with 424 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! 5bab984..71fecb2 refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! a0acfbf...36298fd refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
* [new ref] refs/pull/2488/head -> origin/pr/2488/head
* [new ref] refs/pull/2488/merge -> origin/pr/2488/merge
* [new ref] refs/pull/2489/head -> origin/pr/2489/head
* [new ref] refs/pull/2489/merge -> origin/pr/2489/merge
* [new ref] refs/pull/2490/head -> origin/pr/2490/head
* [new ref] refs/pull/2490/merge -> origin/pr/2490/merge
* [new ref] refs/pull/2491/head -> origin/pr/2491/head
* [new ref] refs/pull/2492/head -> origin/pr/2492/head
* [new ref] refs/pull/2492/merge -> origin/pr/2492/merge
* [new ref] refs/pull/2493/head -> origin/pr/2493/head
* [new ref] refs/pull/2493/merge -> origin/pr/2493/merge
* [new ref] refs/pull/2494/head -> origin/pr/2494/head
* [new ref] refs/pull/2495/head -> origin/pr/2495/head
* [new ref] refs/pull/2495/merge -> origin/pr/2495/merge
* [new ref] refs/pull/2496/head -> origin/pr/2496/head
* [new ref] refs/pull/2496/merge -> origin/pr/2496/merge
* [new ref] refs/pull/2497/head -> origin/pr/2497/head
* [new ref] refs/pull/2497/merge -> origin/pr/2497/merge
* [new ref] refs/pull/2498/head -> origin/pr/2498/head
* [new ref] refs/pull/2498/merge -> origin/pr/2498/merge
* [new ref] refs/pull/2499/head -> origin/pr/2499/head
* [new ref] refs/pull/2499/merge -> origin/pr/2499/merge
* [new ref] refs/pull/2500/head -> origin/pr/2500/head
* [new ref] refs/pull/2500/merge -> origin/pr/2500/merge
* [new ref] refs/pull/2501/head -> origin/pr/2501/head
* [new ref] refs/pull/2501/merge -> origin/pr/2501/merge
* [new ref] refs/pull/2502/head -> origin/pr/2502/head
* [new ref] refs/pull/2502/merge -> origin/pr/2502/merge
* [new ref] refs/pull/2503/head -> origin/pr/2503/head
* [new ref] refs/pull/2503/merge -> origin/pr/2503/merge
* [new ref] refs/pull/2504/head -> origin/pr/2504/head
* [new ref] refs/pull/2505/head -> origin/pr/2505/head
* [new ref] refs/pull/2505/merge -> origin/pr/2505/merge
* [new ref] refs/pull/2506/head -> origin/pr/2506/head
* [new ref] refs/pull/2506/merge -> origin/pr/2506/merge
* [new ref] refs/pull/2507/head -> origin/pr/2507/head
* [new ref] refs/pull/2507/merge -> origin/pr/2507/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 82f2f2cff0f026800df465f1bff5451a7891ee13 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 82f2f2cff0f026800df465f1bff5451a7891ee13
> git rev-list 82f2f2cff0f026800df465f1bff5451a7891ee13 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4592404064344980478.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6875976352852390598.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson627598438850954385.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1958208962707412236.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-12 12:02:43,249 f426b514 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/f426b514/pkb.log
2017-04-12 12:02:43,249 f426b514 MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-12 12:02:43,250 f426b514 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-12 12:02:43,643 f426b514 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-12 12:02:43,728 f426b514 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-12 12:02:43,730 f426b514 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-12 12:02:43,731 f426b514 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-12 12:02:43,736 f426b514 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-12 12:02:43,737 f426b514 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-12 12:02:43,763 f426b514 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-12 12:02:43,764 f426b514 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/f426b514/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #298
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/298/display/redirect?page=changes>
Changes:
[dhalperi] Triggers: handle missing case
------------------------------------------
[...truncated 254.70 KB...]
! 3419835...f293534 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! f1831b8...3b3df77 refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! 8770a40...04a1a10 refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! b10a4eb...9a7b24c refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
* [new ref] refs/pull/2488/head -> origin/pr/2488/head
* [new ref] refs/pull/2488/merge -> origin/pr/2488/merge
* [new ref] refs/pull/2489/head -> origin/pr/2489/head
* [new ref] refs/pull/2489/merge -> origin/pr/2489/merge
* [new ref] refs/pull/2490/head -> origin/pr/2490/head
* [new ref] refs/pull/2490/merge -> origin/pr/2490/merge
* [new ref] refs/pull/2491/head -> origin/pr/2491/head
* [new ref] refs/pull/2492/head -> origin/pr/2492/head
* [new ref] refs/pull/2492/merge -> origin/pr/2492/merge
* [new ref] refs/pull/2493/head -> origin/pr/2493/head
* [new ref] refs/pull/2493/merge -> origin/pr/2493/merge
* [new ref] refs/pull/2494/head -> origin/pr/2494/head
* [new ref] refs/pull/2495/head -> origin/pr/2495/head
* [new ref] refs/pull/2495/merge -> origin/pr/2495/merge
* [new ref] refs/pull/2496/head -> origin/pr/2496/head
* [new ref] refs/pull/2496/merge -> origin/pr/2496/merge
* [new ref] refs/pull/2497/head -> origin/pr/2497/head
* [new ref] refs/pull/2497/merge -> origin/pr/2497/merge
* [new ref] refs/pull/2498/head -> origin/pr/2498/head
* [new ref] refs/pull/2498/merge -> origin/pr/2498/merge
* [new ref] refs/pull/2499/head -> origin/pr/2499/head
* [new ref] refs/pull/2499/merge -> origin/pr/2499/merge
* [new ref] refs/pull/2500/head -> origin/pr/2500/head
* [new ref] refs/pull/2500/merge -> origin/pr/2500/merge
* [new ref] refs/pull/2501/head -> origin/pr/2501/head
* [new ref] refs/pull/2501/merge -> origin/pr/2501/merge
* [new ref] refs/pull/2502/head -> origin/pr/2502/head
* [new ref] refs/pull/2502/merge -> origin/pr/2502/merge
* [new ref] refs/pull/2503/head -> origin/pr/2503/head
* [new ref] refs/pull/2503/merge -> origin/pr/2503/merge
* [new ref] refs/pull/2504/head -> origin/pr/2504/head
* [new ref] refs/pull/2505/head -> origin/pr/2505/head
* [new ref] refs/pull/2505/merge -> origin/pr/2505/merge
* [new ref] refs/pull/2506/head -> origin/pr/2506/head
* [new ref] refs/pull/2506/merge -> origin/pr/2506/merge
* [new ref] refs/pull/2507/head -> origin/pr/2507/head
* [new ref] refs/pull/2507/merge -> origin/pr/2507/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! e9486c9...b9337f6 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 82f2f2cff0f026800df465f1bff5451a7891ee13 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 82f2f2cff0f026800df465f1bff5451a7891ee13
> git rev-list ccf247c1daa868cdaf441f918775c94ae6e3aa0b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4622468083935983396.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson868300900290422740.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2258361619248153497.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4209423639641104359.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-12 06:03:28,925 4d7860d0 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/4d7860d0/pkb.log
2017-04-12 06:03:28,925 4d7860d0 MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-12 06:03:28,926 4d7860d0 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-12 06:03:29,270 4d7860d0 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-12 06:03:29,355 4d7860d0 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-12 06:03:29,358 4d7860d0 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-12 06:03:29,358 4d7860d0 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-12 06:03:29,363 4d7860d0 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-12 06:03:29,365 4d7860d0 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-12 06:03:29,391 4d7860d0 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-12 06:03:29,391 4d7860d0 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/4d7860d0/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #297
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/297/display/redirect?page=changes>
Changes:
[tgroh] Fix build breaks caused by overlaps between b615013 and c08b7b1
[robertwb] Ignore more python build artifacts.
[tgroh] Remove Orderdness of Input, Output expansions
[tgroh] Improve Work Rejection handling
[dhalperi] DataflowRunner misc cleanups
[dhalperi] DataflowRunner: send windowing strategy using Runner API proto
[altay] Throw specialized exception in value providers
[dhalperi] DataflowRunner: remove dead code
[tgroh] Clean HFIOWithEmbeddedCassandraTest before Execution
------------------------------------------
[...truncated 279.98 KB...]
! 2951b00...3b60b91 refs/pull/2441/merge -> origin/pr/2441/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 9fdd34f...27c3e86 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2444/merge: No such file or directory
! f2354aa...b597f15 refs/pull/2444/merge -> origin/pr/2444/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2445/merge: No such file or directory
! f0d8585...9f8a203 refs/pull/2445/merge -> origin/pr/2445/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2446/head: No such file or directory
! 4d36c50..4cb1273 refs/pull/2446/head -> origin/pr/2446/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2446/merge: No such file or directory
! c7f80bd...b652cd5 refs/pull/2446/merge -> origin/pr/2446/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2447/merge: No such file or directory
! 28d84dd...a8d46e5 refs/pull/2447/merge -> origin/pr/2447/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! 16a3dee...7709d38 refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2450/head: No such file or directory
! 1bdb766...98b7730 refs/pull/2450/head -> origin/pr/2450/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2450/merge: No such file or directory
! c68271d...9f80d4d refs/pull/2450/merge -> origin/pr/2450/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2451/merge: No such file or directory
! 111216a...04ed807 refs/pull/2451/merge -> origin/pr/2451/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! cdf0221...34949af refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2454/merge: No such file or directory
! 4763830...5070afd refs/pull/2454/merge -> origin/pr/2454/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2455/head: No such file or directory
! 71f7afa...29c2802 refs/pull/2455/head -> origin/pr/2455/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 323bad3...393fdff refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 66bde8c...d67c07c refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! 6f99d16...6968a64 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2459/head: No such file or directory
! b55849d...6f8175f refs/pull/2459/head -> origin/pr/2459/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2459/merge: No such file or directory
! 59253cc...ea17233 refs/pull/2459/merge -> origin/pr/2459/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2460/head: No such file or directory
! 385ee0c...a714e8b refs/pull/2460/head -> origin/pr/2460/head (unable to update local ref)
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
* [new ref] refs/pull/2471/head -> origin/pr/2471/head
* [new ref] refs/pull/2471/merge -> origin/pr/2471/merge
* [new ref] refs/pull/2472/head -> origin/pr/2472/head
* [new ref] refs/pull/2472/merge -> origin/pr/2472/merge
* [new ref] refs/pull/2473/head -> origin/pr/2473/head
* [new ref] refs/pull/2473/merge -> origin/pr/2473/merge
* [new ref] refs/pull/2474/head -> origin/pr/2474/head
* [new ref] refs/pull/2474/merge -> origin/pr/2474/merge
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
* [new ref] refs/pull/2488/head -> origin/pr/2488/head
* [new ref] refs/pull/2488/merge -> origin/pr/2488/merge
* [new ref] refs/pull/2489/head -> origin/pr/2489/head
* [new ref] refs/pull/2489/merge -> origin/pr/2489/merge
* [new ref] refs/pull/2490/head -> origin/pr/2490/head
* [new ref] refs/pull/2490/merge -> origin/pr/2490/merge
* [new ref] refs/pull/2491/head -> origin/pr/2491/head
* [new ref] refs/pull/2492/head -> origin/pr/2492/head
* [new ref] refs/pull/2492/merge -> origin/pr/2492/merge
* [new ref] refs/pull/2493/head -> origin/pr/2493/head
* [new ref] refs/pull/2493/merge -> origin/pr/2493/merge
* [new ref] refs/pull/2494/head -> origin/pr/2494/head
* [new ref] refs/pull/2495/head -> origin/pr/2495/head
* [new ref] refs/pull/2495/merge -> origin/pr/2495/merge
* [new ref] refs/pull/2496/head -> origin/pr/2496/head
* [new ref] refs/pull/2496/merge -> origin/pr/2496/merge
* [new ref] refs/pull/2497/head -> origin/pr/2497/head
* [new ref] refs/pull/2497/merge -> origin/pr/2497/merge
* [new ref] refs/pull/2498/head -> origin/pr/2498/head
* [new ref] refs/pull/2498/merge -> origin/pr/2498/merge
* [new ref] refs/pull/2499/head -> origin/pr/2499/head
* [new ref] refs/pull/2499/merge -> origin/pr/2499/merge
* [new ref] refs/pull/2500/head -> origin/pr/2500/head
* [new ref] refs/pull/2500/merge -> origin/pr/2500/merge
* [new ref] refs/pull/2501/head -> origin/pr/2501/head
* [new ref] refs/pull/2501/merge -> origin/pr/2501/merge
* [new ref] refs/pull/2502/head -> origin/pr/2502/head
* [new ref] refs/pull/2502/merge -> origin/pr/2502/merge
* [new ref] refs/pull/2503/head -> origin/pr/2503/head
* [new ref] refs/pull/2503/merge -> origin/pr/2503/merge
* [new ref] refs/pull/2504/head -> origin/pr/2504/head
* [new ref] refs/pull/2504/merge -> origin/pr/2504/merge
* [new ref] refs/pull/2505/head -> origin/pr/2505/head
* [new ref] refs/pull/2505/merge -> origin/pr/2505/merge
error: unable to resolve reference refs/remotes/origin/pr/278/merge: No such file or directory
! 319114d...4c5e015 refs/pull/278/merge -> origin/pr/278/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! a0f9042...19675f4 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/314/merge: No such file or directory
! 0fdd146...049852e refs/pull/314/merge -> origin/pr/314/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/455/merge: No such file or directory
! 54d38cf...895dfbd refs/pull/455/merge -> origin/pr/455/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 41889ce...81e605c refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam7(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ccf247c1daa868cdaf441f918775c94ae6e3aa0b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ccf247c1daa868cdaf441f918775c94ae6e3aa0b
> git rev-list 38cf23ebe34724b24db390e1bca774c7c77fdd21 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3651263043698769162.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2487658971994449677.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3370579392091835895.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1562026453500387935.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-12 00:05:41,928 9a40508f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/9a40508f/pkb.log
2017-04-12 00:05:41,928 9a40508f MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-12 00:05:41,928 9a40508f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-12 00:05:42,307 9a40508f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-12 00:05:42,469 9a40508f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-12 00:05:42,471 9a40508f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-12 00:05:42,472 9a40508f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-12 00:05:42,478 9a40508f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-12 00:05:42,481 9a40508f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-12 00:05:42,497 9a40508f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-12 00:05:42,497 9a40508f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/9a40508f/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #296
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/296/display/redirect?page=changes>
Changes:
[dhalperi] PubsubIO: remove support for BoundedReader
[dhalperi] Move HashingFn to io/common, switch to better hash
[iemejia] Flip dependency edge between Dataflow runner and IO-GCP
[tgroh] Add Coder utilities for Proto conversions
[dhalperi] Improve HadoopInputFormatIO DisplayData and Cassandra tests
[tgroh] Remove Jdk1.8-tests/.toDelete
------------------------------------------
[...truncated 249.74 KB...]
! 7e0dd10...2cc86f5 refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! bace20f...08ad8b2 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 49f1638...e32d8df refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2378/merge: No such file or directory
! c6d11ae...01ec401 refs/pull/2378/merge -> origin/pr/2378/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 1cc81ea...a1da37d refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2403/merge: No such file or directory
! cd78b7b...18c9ac1 refs/pull/2403/merge -> origin/pr/2403/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! bbb3c84...ca34b8a refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! e09eec6...180830b refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! cef4000...09d8aa8 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! d6345c3...8fd4d87 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! dcd42cd..5bab984 refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 9ea0cc0...fa6a060 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! ab88227...2b1cbb1 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! 7916f75...5f85d8a refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 53495b0...3419835 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! 511da9c...8770a40 refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2472/merge: No such file or directory
! 41eca59...001fecf refs/pull/2472/merge -> origin/pr/2472/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! 4aa78db...c626faa refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 4865948...b10a4eb refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
* [new ref] refs/pull/2488/head -> origin/pr/2488/head
* [new ref] refs/pull/2488/merge -> origin/pr/2488/merge
* [new ref] refs/pull/2489/head -> origin/pr/2489/head
* [new ref] refs/pull/2489/merge -> origin/pr/2489/merge
* [new ref] refs/pull/2490/head -> origin/pr/2490/head
* [new ref] refs/pull/2490/merge -> origin/pr/2490/merge
* [new ref] refs/pull/2491/head -> origin/pr/2491/head
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 5ba5975...e9486c9 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 38cf23ebe34724b24db390e1bca774c7c77fdd21 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 38cf23ebe34724b24db390e1bca774c7c77fdd21
> git rev-list c58f4f89b3026e130b63dc14731a8ee8615e92f5 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson448908302825638812.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4554872022290710881.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7512356137614356356.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2475321513012371134.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-11 18:02:53,034 ea37d95d MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/ea37d95d/pkb.log
2017-04-11 18:02:53,035 ea37d95d MainThread INFO PerfKitBenchmarker version: v1.11.0-37-g0254d50
2017-04-11 18:02:53,035 ea37d95d MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-11 18:02:53,485 ea37d95d MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-11 18:02:53,644 ea37d95d MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-11 18:02:53,648 ea37d95d MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-11 18:02:53,649 ea37d95d MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-11 18:02:53,657 ea37d95d MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-11 18:02:53,660 ea37d95d MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-11 18:02:53,701 ea37d95d MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-11 18:02:53,701 ea37d95d MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/ea37d95d/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #295
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/295/display/redirect>
------------------------------------------
[...truncated 250.46 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! fdd0457...bace20f refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 3a62a5a...49f1638 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! cd1e7e6...6650613 refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 02f01ea...dac3854 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/head: No such file or directory
! 3b30027...b4ce660 refs/pull/2401/head -> origin/pr/2401/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 371a50d...1cc81ea refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/head: No such file or directory
! a078017...a69b46b refs/pull/2406/head -> origin/pr/2406/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 4e897ad...bbb3c84 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! 52cf5f4...e09eec6 refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 66fcdf4...cef4000 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 1ca8b79...d6345c3 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! 9f7f850...dcd42cd refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! ff6e93b...9ea0cc0 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/head: No such file or directory
! f413860...943322c refs/pull/2426/head -> origin/pr/2426/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! e325586...ab88227 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/head: No such file or directory
! d22f59a...58c0832 refs/pull/2430/head -> origin/pr/2430/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! 9d893e6...7916f75 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 91867d9...53495b0 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! 679f861...511da9c refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! 8a475ce...4aa78db refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 4da4e4b...4865948 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
* [new ref] refs/pull/2488/head -> origin/pr/2488/head
* [new ref] refs/pull/2488/merge -> origin/pr/2488/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 1b17b7a...5ba5975 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c58f4f89b3026e130b63dc14731a8ee8615e92f5 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c58f4f89b3026e130b63dc14731a8ee8615e92f5
> git rev-list c58f4f89b3026e130b63dc14731a8ee8615e92f5 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1949621806901968530.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5062811182093203483.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6812104366523762537.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5050271534221786868.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-11 12:02:48,460 37010055 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/37010055/pkb.log
2017-04-11 12:02:48,460 37010055 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-11 12:02:48,461 37010055 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-11 12:02:48,821 37010055 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-11 12:02:48,910 37010055 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-11 12:02:48,913 37010055 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-11 12:02:48,913 37010055 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-11 12:02:48,918 37010055 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-11 12:02:48,927 37010055 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-11 12:02:48,944 37010055 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-11 12:02:48,945 37010055 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/37010055/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #294
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/294/display/redirect?page=changes>
Changes:
[tgroh] Move WindowingStrategies to runners-core-construction
[kirpichov] Removes DoFn.ProcessContinuation completely
[kirpichov] Bump Dataflow worker to 20170410
------------------------------------------
[...truncated 278.84 KB...]
* [new ref] refs/pull/2423/head -> origin/pr/2423/head
* [new ref] refs/pull/2423/merge -> origin/pr/2423/merge
* [new ref] refs/pull/2424/head -> origin/pr/2424/head
* [new ref] refs/pull/2424/merge -> origin/pr/2424/merge
* [new ref] refs/pull/2425/head -> origin/pr/2425/head
* [new ref] refs/pull/2426/head -> origin/pr/2426/head
* [new ref] refs/pull/2426/merge -> origin/pr/2426/merge
* [new ref] refs/pull/2427/head -> origin/pr/2427/head
* [new ref] refs/pull/2427/merge -> origin/pr/2427/merge
* [new ref] refs/pull/2428/head -> origin/pr/2428/head
* [new ref] refs/pull/2428/merge -> origin/pr/2428/merge
* [new ref] refs/pull/2429/head -> origin/pr/2429/head
* [new ref] refs/pull/2430/head -> origin/pr/2430/head
* [new ref] refs/pull/2430/merge -> origin/pr/2430/merge
* [new ref] refs/pull/2431/head -> origin/pr/2431/head
* [new ref] refs/pull/2431/merge -> origin/pr/2431/merge
* [new ref] refs/pull/2432/head -> origin/pr/2432/head
* [new ref] refs/pull/2432/merge -> origin/pr/2432/merge
* [new ref] refs/pull/2433/head -> origin/pr/2433/head
* [new ref] refs/pull/2433/merge -> origin/pr/2433/merge
* [new ref] refs/pull/2434/head -> origin/pr/2434/head
* [new ref] refs/pull/2434/merge -> origin/pr/2434/merge
* [new ref] refs/pull/2435/head -> origin/pr/2435/head
* [new ref] refs/pull/2435/merge -> origin/pr/2435/merge
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
* [new ref] refs/pull/2471/head -> origin/pr/2471/head
* [new ref] refs/pull/2471/merge -> origin/pr/2471/merge
* [new ref] refs/pull/2472/head -> origin/pr/2472/head
* [new ref] refs/pull/2472/merge -> origin/pr/2472/merge
* [new ref] refs/pull/2473/head -> origin/pr/2473/head
* [new ref] refs/pull/2473/merge -> origin/pr/2473/merge
* [new ref] refs/pull/2474/head -> origin/pr/2474/head
* [new ref] refs/pull/2474/merge -> origin/pr/2474/merge
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
error: unable to resolve reference refs/remotes/origin/pr/278/merge: No such file or directory
! 319114d...4c5e015 refs/pull/278/merge -> origin/pr/278/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! a0f9042...19675f4 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/311/merge: No such file or directory
! 9cbefd4...b1b5420 refs/pull/311/merge -> origin/pr/311/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/314/merge: No such file or directory
! 0fdd146...049852e refs/pull/314/merge -> origin/pr/314/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/455/merge: No such file or directory
! 54d38cf...895dfbd refs/pull/455/merge -> origin/pr/455/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! fbb6f89...5ba5975 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! d5dd848...7a7cff5 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c58f4f89b3026e130b63dc14731a8ee8615e92f5 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c58f4f89b3026e130b63dc14731a8ee8615e92f5
> git rev-list 7fd9c6516e2222a5f3d290fd95507559b0c99940 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4079288884855686022.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2238358916724584886.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2730163199137378929.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8354405683946942183.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-11 06:02:32,985 df397436 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/df397436/pkb.log
2017-04-11 06:02:32,985 df397436 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-11 06:02:32,986 df397436 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-11 06:02:33,725 df397436 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-11 06:02:33,840 df397436 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-11 06:02:33,842 df397436 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-11 06:02:33,842 df397436 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-11 06:02:33,849 df397436 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-11 06:02:33,851 df397436 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-11 06:02:33,870 df397436 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-11 06:02:33,871 df397436 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/df397436/pkb.log
Build step 'Execute shell' marked build as failure