You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/03/25 18:02:37 UTC
Build failed in Jenkins: beam_PerformanceTests_Dataflow #229
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/229/display/redirect?page=changes>
Changes:
[amitsela33] Fix caching in the Spark streaming, doing the cache update in the
------------------------------------------
[...truncated 239.20 KB...]
! 69f1b2c...9de8b28 refs/pull/2246/merge -> origin/pr/2246/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2249/merge: No such file or directory
! f321859...acb1ef3 refs/pull/2249/merge -> origin/pr/2249/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2253/merge: No such file or directory
! 3891373...cbd821e refs/pull/2253/merge -> origin/pr/2253/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2255/merge: No such file or directory
! 5d9ba26...73db42a refs/pull/2255/merge -> origin/pr/2255/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2256/merge: No such file or directory
! 5e70822...235915a refs/pull/2256/merge -> origin/pr/2256/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2257/merge: No such file or directory
! 304973c...b00a0c4 refs/pull/2257/merge -> origin/pr/2257/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2258/merge: No such file or directory
! b9eaefa...811d426 refs/pull/2258/merge -> origin/pr/2258/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2260/merge: No such file or directory
! ef9ae02...dc4c58d refs/pull/2260/merge -> origin/pr/2260/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2261/merge: No such file or directory
! 7279cf0...9434c60 refs/pull/2261/merge -> origin/pr/2261/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2262/merge: No such file or directory
! e3f23c3...2ccf4f3 refs/pull/2262/merge -> origin/pr/2262/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2263/merge: No such file or directory
! 6799cf2...5ba4146 refs/pull/2263/merge -> origin/pr/2263/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2264/merge: No such file or directory
! df44573...14935b1 refs/pull/2264/merge -> origin/pr/2264/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! 39f5f85...f391d18 refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2267/merge: No such file or directory
! e8e818d...b4405de refs/pull/2267/merge -> origin/pr/2267/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2268/merge: No such file or directory
! 54ec413...474d1f4 refs/pull/2268/merge -> origin/pr/2268/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2269/merge: No such file or directory
! 2da5347...0af40ed refs/pull/2269/merge -> origin/pr/2269/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2271/merge: No such file or directory
! 431d3f6...fc11a6a refs/pull/2271/merge -> origin/pr/2271/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2272/merge: No such file or directory
! e0ac186...93e3fcd refs/pull/2272/merge -> origin/pr/2272/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! de72b25...7cbdd2b refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2275/merge: No such file or directory
! a9f73ad...85e5b7e refs/pull/2275/merge -> origin/pr/2275/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2277/merge: No such file or directory
! bb651d2...cd56c15 refs/pull/2277/merge -> origin/pr/2277/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2279/merge: No such file or directory
! 61c32b1...7154f06 refs/pull/2279/merge -> origin/pr/2279/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2280/merge: No such file or directory
! 95565f1...6208d08 refs/pull/2280/merge -> origin/pr/2280/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2282/merge: No such file or directory
! ed85176...d8bb1c9 refs/pull/2282/merge -> origin/pr/2282/merge (unable to update local ref)
* [new ref] refs/pull/2283/head -> origin/pr/2283/head
* [new ref] refs/pull/2283/merge -> origin/pr/2283/merge
* [new ref] refs/pull/2284/head -> origin/pr/2284/head
* [new ref] refs/pull/2284/merge -> origin/pr/2284/merge
* [new ref] refs/pull/2285/head -> origin/pr/2285/head
* [new ref] refs/pull/2285/merge -> origin/pr/2285/merge
* [new ref] refs/pull/2286/head -> origin/pr/2286/head
* [new ref] refs/pull/2286/merge -> origin/pr/2286/merge
* [new ref] refs/pull/2287/head -> origin/pr/2287/head
* [new ref] refs/pull/2287/merge -> origin/pr/2287/merge
* [new ref] refs/pull/2288/head -> origin/pr/2288/head
* [new ref] refs/pull/2288/merge -> origin/pr/2288/merge
* [new ref] refs/pull/2289/head -> origin/pr/2289/head
* [new ref] refs/pull/2289/merge -> origin/pr/2289/merge
* [new ref] refs/pull/2290/head -> origin/pr/2290/head
* [new ref] refs/pull/2290/merge -> origin/pr/2290/merge
* [new ref] refs/pull/2291/head -> origin/pr/2291/head
* [new ref] refs/pull/2291/merge -> origin/pr/2291/merge
* [new ref] refs/pull/2292/head -> origin/pr/2292/head
* [new ref] refs/pull/2292/merge -> origin/pr/2292/merge
* [new ref] refs/pull/2293/head -> origin/pr/2293/head
* [new ref] refs/pull/2293/merge -> origin/pr/2293/merge
* [new ref] refs/pull/2294/head -> origin/pr/2294/head
* [new ref] refs/pull/2294/merge -> origin/pr/2294/merge
* [new ref] refs/pull/2295/head -> origin/pr/2295/head
* [new ref] refs/pull/2295/merge -> origin/pr/2295/merge
* [new ref] refs/pull/2296/head -> origin/pr/2296/head
* [new ref] refs/pull/2296/merge -> origin/pr/2296/merge
* [new ref] refs/pull/2297/head -> origin/pr/2297/head
* [new ref] refs/pull/2297/merge -> origin/pr/2297/merge
* [new ref] refs/pull/2298/head -> origin/pr/2298/head
* [new ref] refs/pull/2298/merge -> origin/pr/2298/merge
* [new ref] refs/pull/2299/head -> origin/pr/2299/head
* [new ref] refs/pull/2300/head -> origin/pr/2300/head
* [new ref] refs/pull/2300/merge -> origin/pr/2300/merge
* [new ref] refs/pull/2301/head -> origin/pr/2301/head
* [new ref] refs/pull/2301/merge -> origin/pr/2301/merge
* [new ref] refs/pull/2302/head -> origin/pr/2302/head
* [new ref] refs/pull/2302/merge -> origin/pr/2302/merge
* [new ref] refs/pull/2303/head -> origin/pr/2303/head
* [new ref] refs/pull/2303/merge -> origin/pr/2303/merge
* [new ref] refs/pull/2304/head -> origin/pr/2304/head
* [new ref] refs/pull/2304/merge -> origin/pr/2304/merge
* [new ref] refs/pull/2305/head -> origin/pr/2305/head
* [new ref] refs/pull/2305/merge -> origin/pr/2305/merge
* [new ref] refs/pull/2306/head -> origin/pr/2306/head
* [new ref] refs/pull/2306/merge -> origin/pr/2306/merge
* [new ref] refs/pull/2307/head -> origin/pr/2307/head
* [new ref] refs/pull/2307/merge -> origin/pr/2307/merge
* [new ref] refs/pull/2308/head -> origin/pr/2308/head
* [new ref] refs/pull/2308/merge -> origin/pr/2308/merge
* [new ref] refs/pull/2309/head -> origin/pr/2309/head
* [new ref] refs/pull/2309/merge -> origin/pr/2309/merge
* [new ref] refs/pull/2310/head -> origin/pr/2310/head
* [new ref] refs/pull/2310/merge -> origin/pr/2310/merge
* [new ref] refs/pull/2311/head -> origin/pr/2311/head
* [new ref] refs/pull/2311/merge -> origin/pr/2311/merge
* [new ref] refs/pull/2312/head -> origin/pr/2312/head
* [new ref] refs/pull/2312/merge -> origin/pr/2312/merge
* [new ref] refs/pull/2313/head -> origin/pr/2313/head
* [new ref] refs/pull/2313/merge -> origin/pr/2313/merge
* [new ref] refs/pull/2314/head -> origin/pr/2314/head
* [new ref] refs/pull/2314/merge -> origin/pr/2314/merge
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 39f0ca4...ed268ba refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3473055f2358533dfb18af225ffdee2c8eca4000 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3473055f2358533dfb18af225ffdee2c8eca4000
> git rev-list fe2369933a9f1116f22916b34fa13425efdc1a52 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4634065777267090199.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4786930119731594209.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8262270208092680845.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7005138063965104867.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-25 18:02:36,535 93ceeed3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/93ceeed3/pkb.log
2017-03-25 18:02:36,536 93ceeed3 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-25 18:02:36,536 93ceeed3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-25 18:02:36,790 93ceeed3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-25 18:02:36,921 93ceeed3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-25 18:02:36,924 93ceeed3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-25 18:02:36,924 93ceeed3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-25 18:02:36,929 93ceeed3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-25 18:02:36,931 93ceeed3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-25 18:02:36,956 93ceeed3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-25 18:02:36,957 93ceeed3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/93ceeed3/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #376
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/376/display/redirect?page=changes>
Changes:
[klk] Activate WindowedWordCountIT on Apex runner
[klk] No parallelism for Apex WindowedWordCountIT
[dhalperi] [BEAM-2016] Delete HdfsFileSource & Sink
[tgroh] Run Optimize Imports on the Repository
[tgroh] Move AppliedPTransform into the Runners package
[tgroh] Convert Coder into an Abstract Static Class
[dhalperi] [BEAM-59] Fully delete IOChannelUtils
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0d2a0aeeef92bdbc23e4061ec066da47e3c7de38 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 0d2a0aeeef92bdbc23e4061ec066da47e3c7de38
> git rev-list 3bffe0e0014bdd6ae73dc2e8ecfc2b61d066120c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6165280624966686801.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4580259411695657974.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson991341416332915944.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4900402012477053724.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 18:54:23,115 424c35d3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/424c35d3/pkb.log
2017-05-05 18:54:23,115 424c35d3 MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 18:54:23,116 424c35d3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 18:54:23,645 424c35d3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 18:54:23,740 424c35d3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 18:54:23,743 424c35d3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 18:54:23,743 424c35d3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 18:54:23,748 424c35d3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 18:54:23,750 424c35d3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 18:54:23,776 424c35d3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 18:54:23,776 424c35d3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/424c35d3/pkb.log
2017-05-05 18:54:23,777 424c35d3 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/424c35d3/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #375
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/375/display/redirect?page=changes>
Changes:
[aljoscha.krettek] [BEAM-1862] SplittableDoFnOperator should close the
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3bffe0e0014bdd6ae73dc2e8ecfc2b61d066120c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3bffe0e0014bdd6ae73dc2e8ecfc2b61d066120c
> git rev-list 7903e59c4e07822f8def85ee6a7f8ef3ccb1ca7a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2417919858563827519.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7895987214291620795.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2766035856415306403.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5946974480346757738.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 12:00:18,732 d6d41712 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d6d41712/pkb.log
2017-05-05 12:00:18,732 d6d41712 MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 12:00:18,733 d6d41712 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 12:00:19,014 d6d41712 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 12:00:19,172 d6d41712 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 12:00:19,176 d6d41712 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 12:00:19,177 d6d41712 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 12:00:19,185 d6d41712 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 12:00:19,187 d6d41712 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 12:00:19,240 d6d41712 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 12:00:19,240 d6d41712 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d6d41712/pkb.log
2017-05-05 12:00:19,240 d6d41712 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/d6d41712/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #374
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/374/display/redirect?page=changes>
Changes:
[klk] Move Java sdk.util.state to sdk.state
[klk] Add @Internal and @Experimental to state package
[klk] Move user-facing timer-related classes out of util
[klk] Mark TimeDomain experimental alongside Timers; improve javadoc
[klk] Move WindowingStrategy from util to values
[klk] Move PathValidator adjacent to other filesystem bits
[klk] Move SideInputReader to runners/core-java
[klk] Move Reshuffle and ReshuffleTrigger out of util
[klk] Move ValueWithRecordId to sdk.values, annotated
[klk] Move some PCollectionView bits out of util
[klk] Update Dataflow worker to 20170504-2
[tgroh] Update expectation in ProcessBundleHandlerTest
[dhalperi] [BEAM-1871] Move out test only utilities used only in examples/java out
[dhalperi] Revert "This closes #2905"
[klk] Adjust error message expectation in DoFnSignaturesTest
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 7903e59c4e07822f8def85ee6a7f8ef3ccb1ca7a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 7903e59c4e07822f8def85ee6a7f8ef3ccb1ca7a
> git rev-list 2f4dd8dfaf9e94ff2a1f97edc695fbcd75be34cd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7538084356404224735.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4042714355130252232.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson426470528539862612.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4859371696513139763.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 06:00:18,988 fd9fd549 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/fd9fd549/pkb.log
2017-05-05 06:00:18,988 fd9fd549 MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 06:00:18,989 fd9fd549 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 06:00:19,229 fd9fd549 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 06:00:19,314 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 06:00:20,165 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 06:00:20,165 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 06:00:20,170 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 06:00:20,172 fd9fd549 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 06:00:20,203 fd9fd549 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 06:00:20,204 fd9fd549 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/fd9fd549/pkb.log
2017-05-05 06:00:20,204 fd9fd549 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/fd9fd549/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #373
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/373/display/redirect?page=changes>
Changes:
[dhalperi] GCP-IO: manage versions in top level pom
[dhalperi] Remove IOChannelUtil/Factory from BigQueryIO
[klk] Eliminate Pipeline.getOptions
[robertwb] Cleanup old cython files before testing again
[klk] [BEAM-1727] Add align and offset to Timer
[klk] Fix initial watermark of DoFnOperator in Flink runner
[dhalperi] [BEAM-59] Remove IOChannelUtils, IOChannelFactory
[dhalperi] Move thrown.expect to correct place
[tgroh] Note when checkpoints may be committed.
[tgroh] Split StartBundleContext and FinishBundleContext
[kirpichov] [BEAM-2170] PubsubMessageWithAttributesCoder should not NPE on messages
[kirpichov] Makes PubsubMessagePayloadOnlyCoder not require whole-stream context
[kirpichov] Moves coder choice into PubsubSource
[davor] [BEAM-2144] Remove transform.reflect and utils from Javadocs
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2f4dd8dfaf9e94ff2a1f97edc695fbcd75be34cd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2f4dd8dfaf9e94ff2a1f97edc695fbcd75be34cd
> git rev-list b73918b55ab06e5a47ef9dc33ae3dbaebaed330a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson227170201862895542.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5916819713713284246.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5309455617960359779.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7566161025314604258.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-05 00:00:58,427 4a3fc96e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/4a3fc96e/pkb.log
2017-05-05 00:00:58,465 4a3fc96e MainThread INFO PerfKitBenchmarker version: v1.11.0-49-g10dd95b
2017-05-05 00:00:58,465 4a3fc96e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-05 00:00:59,060 4a3fc96e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-05 00:00:59,163 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-05 00:00:59,165 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-05 00:00:59,166 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-05 00:00:59,170 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-05 00:00:59,172 4a3fc96e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-05 00:00:59,200 4a3fc96e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-05 00:00:59,201 4a3fc96e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/4a3fc96e/pkb.log
2017-05-05 00:00:59,201 4a3fc96e MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/4a3fc96e/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #372
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/372/display/redirect?page=changes>
Changes:
[klk] Annotate internal methods of PCollection
[klk] Annotate internal pieces of sdks.transforms
[klk] Tighten access control and internal annotations for triggers
[klk] The transforms.reflect package is not for users
[klk] Annotate internal-only bits of Java sdk.runners
[klk] Tighten access in sdk.options
[klk] Annotate internal methods on Pipeline
[lcwik] [BEAM-2165] Update Apex to support serializing/deserializing custom user
[lcwik] [BEAM-2165] Update Dataflow to support serializing/deserializing custom
[lcwik] [BEAM-2165] Update Flink to support serializing/deserializing custom
[lcwik] [BEAM-1871] Migrate ReleaseInfo away from Google API client GenericJson
[dhalperi] DataflowRunner: integration test GCP-IO
[lcwik] [BEAM-1491]Identify HADOOP_CONF_DIR(or YARN_CONF_DIR) environment
[lcwik] Split Coder's encode/decode methods into two methods depending on
[dhalperi] [BEAM-2162] Add logging to long BigQuery jobs
[tgroh] Use BinaryCombineLongFn in GroupIntoBatches
[altay] [BEAM-2152] Remove gcloud auth as application default credentials does
[dhalperi] AvroIOTest: stop using IOChannelUtils, remove invalid test
[dhalperi] DataflowRunner: switch from IOChannels to FileSystems for creating files
[dhalperi] DataflowPipelineOptions: use FileSystems, not IOChannelUtils, to resolve
[dhalperi] Stop registering IOChannelFactories in SDK harness, runners, tests
[dhalperi] FileSystems: add match(String) for single spec
[dhalperi] WriteWithShardingFactoryTest: switch to FileSystems
[dhalperi] ReadTranslator: remove outdated comment
[dhalperi] TFRecordIO: switch to FileSystems from IOChannelUtils
[lcwik] Remove POutput#recordAsOutput
[robertwb] One more TaggedOutput name change.
[dhalperi] Update JavaDoc of checkpoint, and expose `enable.auto.commit` for more
[lcwik] Use CloudObject encodings in the Beam Fn Harness
[aviemzur] [BEAM-1763] Verify PAssert execution in runners which support metrics.
[aviemzur] [BEAM-1726] Fix empty side inputs in Flink Streaming Runner
[aviemzur] [BEAM-1726] Fix RuntimeException throwing in FlinkStateInternals
[aviemzur] [BEAM-1726] Fix Flatten with input copies in Flink Streaming Runner
[aviemzur] [BEAM-1763] Replace usage of PipelineRule with TestPipeline in Spark
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam2 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b73918b55ab06e5a47ef9dc33ae3dbaebaed330a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b73918b55ab06e5a47ef9dc33ae3dbaebaed330a
> git rev-list ff6bb353002610169a8079d1164118606bebb21e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8302199996735440149.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6393172615410736925.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4182315741520362001.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2998196018294298494.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 18:18:28,736 8fcb4f87 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/8fcb4f87/pkb.log
2017-05-04 18:18:28,736 8fcb4f87 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 18:18:28,737 8fcb4f87 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 18:18:29,449 8fcb4f87 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 18:18:29,614 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 18:18:29,617 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 18:18:29,617 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 18:18:29,624 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 18:18:29,627 8fcb4f87 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 18:18:29,681 8fcb4f87 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 18:18:29,682 8fcb4f87 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/8fcb4f87/pkb.log
2017-05-04 18:18:29,682 8fcb4f87 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/8fcb4f87/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #371
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/371/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ff6bb353002610169a8079d1164118606bebb21e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ff6bb353002610169a8079d1164118606bebb21e
> git rev-list ff6bb353002610169a8079d1164118606bebb21e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1079305215059373945.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson400584237070228302.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6782621028537445695.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2869572068032251778.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 12:01:19,146 397f971b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/397f971b/pkb.log
2017-05-04 12:01:19,147 397f971b MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 12:01:19,147 397f971b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 12:01:19,263 397f971b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 12:01:19,350 397f971b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 12:01:19,352 397f971b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 12:01:19,352 397f971b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 12:01:19,358 397f971b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 12:01:19,360 397f971b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 12:01:19,386 397f971b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 12:01:19,386 397f971b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/397f971b/pkb.log
2017-05-04 12:01:19,386 397f971b MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/397f971b/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #370
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/370/display/redirect?page=changes>
Changes:
[dhalperi] Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems
[tgroh] Inline TypedPValue
[lcwik] [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions
[kirpichov] Provides a default coder for PubsubMessage
[kirpichov] Moves PubsubMessage to upper level and renames payload
[klk] BigQueryIO: Remove tempLocation usage at pipeline construction time
[dhalperi] Removal of Aggregator class. Also removal from comments.
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ff6bb353002610169a8079d1164118606bebb21e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ff6bb353002610169a8079d1164118606bebb21e
> git rev-list b4bafd09282cf66adf121b750d3e2d9e5a0fefbe # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1444438434785476686.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7081035498281775005.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2859973814943599527.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7637998100796022197.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 06:00:42,550 b7a79798 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b7a79798/pkb.log
2017-05-04 06:00:42,550 b7a79798 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 06:00:42,550 b7a79798 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 06:00:42,855 b7a79798 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 06:00:42,964 b7a79798 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 06:00:42,966 b7a79798 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 06:00:42,967 b7a79798 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 06:00:42,972 b7a79798 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 06:00:42,974 b7a79798 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 06:00:43,001 b7a79798 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 06:00:43,002 b7a79798 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b7a79798/pkb.log
2017-05-04 06:00:43,002 b7a79798 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/b7a79798/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #369
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/369/display/redirect?page=changes>
Changes:
[klk] Use Thread context ClassLoader as parent in AvroCoderTest
[tgroh] Mark all PCollectionView methods internal
[lcwik] [BEAM-1871] Move GCP specific serialization CloudObject and supporting
[tgroh] Reduce visibility of DirectRunner classes
[altay] Retry on correct error codes for datastoreio
[robertwb] Try PTransform-based coder inference before using fallback coder.
[robertwb] Fix coder inference ambiguity in CombineFnsTest.
[klk] Remove job name usages from BigQueryIO at pipeline construction time
[kirpichov] Fully general dynamic tables (including schemas) in BigQueryIO.
[kirpichov] Fixes PubsubIO.Write translation in Dataflow runner
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam2 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b4bafd09282cf66adf121b750d3e2d9e5a0fefbe (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b4bafd09282cf66adf121b750d3e2d9e5a0fefbe
> git rev-list 0d19d3cb210ef179e1831b971f7cf6d3d6bb1dde # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson197114110450717999.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2867269520771524429.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4022959279102052127.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1410710530977960850.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-04 00:03:05,091 822da785 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/822da785/pkb.log
2017-05-04 00:03:05,093 822da785 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-04 00:03:05,094 822da785 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-04 00:03:05,598 822da785 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-04 00:03:05,733 822da785 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-04 00:03:05,736 822da785 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-04 00:03:05,736 822da785 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-04 00:03:05,748 822da785 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-04 00:03:05,750 822da785 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-04 00:03:05,803 822da785 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-04 00:03:05,804 822da785 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/822da785/pkb.log
2017-05-04 00:03:05,804 822da785 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/822da785/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #368
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/368/display/redirect?page=changes>
Changes:
[klk] Use LinkedHashMap for step contexts in BaseExecutionContext
[dhalperi] Remove IoChannelUtils from PackageUtil
[dhalperi] [BEAM-59] FileChecksumMatcherTest: switch from IOChannelUtils to java
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0d19d3cb210ef179e1831b971f7cf6d3d6bb1dde (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 0d19d3cb210ef179e1831b971f7cf6d3d6bb1dde
> git rev-list 3b61f6a9034b3dbb8b08f695b7b526656660c8a6 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8822402256232841916.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6143726776491349836.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5896650652856289214.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3659993746409279566.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 18:04:37,849 33130c4f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/33130c4f/pkb.log
2017-05-03 18:04:37,849 33130c4f MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 18:04:37,850 33130c4f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 18:04:38,526 33130c4f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 18:04:38,662 33130c4f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 18:04:38,664 33130c4f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 18:04:38,665 33130c4f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 18:04:38,673 33130c4f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 18:04:38,676 33130c4f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 18:04:38,709 33130c4f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 18:04:38,709 33130c4f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/33130c4f/pkb.log
2017-05-03 18:04:38,710 33130c4f MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/33130c4f/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #367
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/367/display/redirect?page=changes>
Changes:
[vikasrk] Triggers for Java SDK post submit tests
[kirpichov] Removed coder and parseFn from PubsubIO.Read
[kirpichov] Removed coder and formatFn from PubsubIO.Write
[kirpichov] Introduces read/writePubsubMessages
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3b61f6a9034b3dbb8b08f695b7b526656660c8a6 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3b61f6a9034b3dbb8b08f695b7b526656660c8a6
> git rev-list dc0fdcb7e62067fdc629b8558659fce7e37e4856 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5223032132045342938.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3069112977640495240.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2562948682559758564.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4871808138669294515.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 12:00:18,040 00eb0167 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/00eb0167/pkb.log
2017-05-03 12:00:18,041 00eb0167 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 12:00:18,041 00eb0167 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 12:00:18,338 00eb0167 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 12:00:18,436 00eb0167 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 12:00:18,439 00eb0167 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 12:00:18,439 00eb0167 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 12:00:18,445 00eb0167 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 12:00:18,448 00eb0167 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 12:00:18,467 00eb0167 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 12:00:18,468 00eb0167 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/00eb0167/pkb.log
2017-05-03 12:00:18,468 00eb0167 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/00eb0167/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #366
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/366/display/redirect?page=changes>
Changes:
[robertwb] Deprecate <pipeline>.options usage
[lcwik] Remove Coder.asCloudObject and related methods
[altay] Updating Dataflow API protos and client
[tgroh] Add Additional CloudObjectTranslators
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision dc0fdcb7e62067fdc629b8558659fce7e37e4856 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f dc0fdcb7e62067fdc629b8558659fce7e37e4856
> git rev-list 3bb0f8e6ad8a2b378a656731732a79c9c16e4a8d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4609501167634798019.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9117219116175138012.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson380355071913316710.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6791561348024361129.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 06:00:33,733 714e3efe MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/714e3efe/pkb.log
2017-05-03 06:00:33,733 714e3efe MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 06:00:33,734 714e3efe MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 06:00:33,998 714e3efe MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 06:00:34,082 714e3efe MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 06:00:34,084 714e3efe MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 06:00:34,085 714e3efe MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 06:00:34,090 714e3efe MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 06:00:34,092 714e3efe MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 06:00:34,119 714e3efe MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 06:00:34,119 714e3efe MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/714e3efe/pkb.log
2017-05-03 06:00:34,120 714e3efe MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/714e3efe/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #365
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/365/display/redirect?page=changes>
Changes:
[klk] Use processing time for synchronized processing time in Flink runner
[klk] Simplify type parameters of StateSpec and related
[klk] Make DoFnSignatures robust to StateSpec subclasses
[kirpichov] Removes leftover no-op withoutValidation methods
[kirpichov] Removes TextIO.Read.Bound
[kirpichov] Converts TextIO.Read to AutoValue
[kirpichov] Removes TextIO.Write.Bound
[kirpichov] Converts TextIO.Write to AutoValue
[kirpichov] Moves TextSource and TextSink to top level
[lcwik] [BEAM-2135] Move hdfs to hadoop-file-system
[dhalperi] [BEAM-2141] Disable JDBC tests
[dhalperi] BigQuery: swap from asSingleton to asIterable for Cleanup
[lcwik] [BEAM-2020] Convert all unknown Coders into CustomCoder CloudObjects
[chamikara] [BEAM-539] Fixes several issues of FileSink.
[altay] [BEAM-1316] Remove the usage of mock from ptransform tests
[lcwik] [BEAM-2135] Fix pointers to GCP-core
[klk] Skip null options when converting back to argv
[klk] Instantiate runner briefly in Pipeline
[lcwik] [BEAM-2135] Fix pointers to sdks/java/io/hadoop-file-system
[davor] [BEAM-2093] Use the jackson version from the maven property in maven
[dhalperi] [BEAM-59] Delete old restrictions on output file paths
[lcwik] [BEAM-2139] Disable SplittableDoFn ValidatesRunner tests for Streaming
[dhalperi] [BEAM-59] Move GcsFileSystem to gcp-core
[dhalperi] Full removal of Aggregators in Java SDK and Runners
[davor] Include LICENSE and NOTICE in python dist files
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3bb0f8e6ad8a2b378a656731732a79c9c16e4a8d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3bb0f8e6ad8a2b378a656731732a79c9c16e4a8d
> git rev-list eec903fb538eb9c3d41d737dba94a41f7c1c469e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4423006436169070601.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5338004820536756484.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1500182718279178360.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5189078248202599501.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-03 00:02:38,285 bc160be8 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bc160be8/pkb.log
2017-05-03 00:02:38,285 bc160be8 MainThread INFO PerfKitBenchmarker version: v1.11.0-48-ge557505
2017-05-03 00:02:38,286 bc160be8 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-03 00:02:38,833 bc160be8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-03 00:02:38,932 bc160be8 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-03 00:02:38,934 bc160be8 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-03 00:02:38,934 bc160be8 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-03 00:02:38,939 bc160be8 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-03 00:02:38,941 bc160be8 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-03 00:02:38,962 bc160be8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-03 00:02:38,963 bc160be8 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bc160be8/pkb.log
2017-05-03 00:02:38,963 bc160be8 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/bc160be8/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #364
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/364/display/redirect?page=changes>
Changes:
[wtanaka] Add comments to Trigger.java
[iemejia] [BEAM-1764] Remove aggregators from Flink Runner
[davor] Update github PR template after travis removal.
[altay] Add retry logic for job creation
[tgroh] Add an @Internal Annotation
[robertwb] Revert clean else-return lint changes.
[lcwik] [BEAM-2135] Move gcp-core to google-cloud-platform-core
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam4 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:809)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1076)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1107)
at hudson.scm.SCM.checkout(SCM.java:496)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1281)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1728)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:405)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*" returned status code 128:
stdout:
stderr: error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision eec903fb538eb9c3d41d737dba94a41f7c1c469e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f eec903fb538eb9c3d41d737dba94a41f7c1c469e
> git rev-list ae72456b7125a28f2db4b8dad2990b2bb063ca9b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8706026561929483622.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson425751425269746362.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4441358561143021270.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1024427901516202230.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 18:25:21,716 554ad8e1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/554ad8e1/pkb.log
2017-05-02 18:25:21,718 554ad8e1 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 18:25:21,719 554ad8e1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 18:25:22,240 554ad8e1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 18:25:22,450 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 18:25:22,454 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 18:25:22,454 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 18:25:22,462 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 18:25:22,465 554ad8e1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 18:25:22,509 554ad8e1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 18:25:22,510 554ad8e1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/554ad8e1/pkb.log
2017-05-02 18:25:22,510 554ad8e1 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/554ad8e1/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #363
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/363/display/redirect?page=changes>
Changes:
[dhalperi] Remove Aggregators from StatefulDoFn runner
[dhalperi] Removing Aggregator from core runner code
[dhalperi] Remove accumulators from DoFn tester.
[jbonofre] Remove unneeded elements from the POM files
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ae72456b7125a28f2db4b8dad2990b2bb063ca9b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ae72456b7125a28f2db4b8dad2990b2bb063ca9b
> git rev-list e92ead58cd661ff7ee952278f2983a578bdd2412 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8808595505571951135.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5575995026223943279.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4231598413718564875.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4168573447482597019.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 12:00:25,291 c5c7fb81 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c5c7fb81/pkb.log
2017-05-02 12:00:25,291 c5c7fb81 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 12:00:25,292 c5c7fb81 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 12:00:25,623 c5c7fb81 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 12:00:25,715 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 12:00:25,717 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 12:00:25,718 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 12:00:25,723 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 12:00:25,726 c5c7fb81 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 12:00:25,746 c5c7fb81 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 12:00:25,746 c5c7fb81 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c5c7fb81/pkb.log
2017-05-02 12:00:25,747 c5c7fb81 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/c5c7fb81/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #362
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/362/display/redirect?page=changes>
Changes:
[robertwb] Fn API support for Python.
[robertwb] Rename OutputValue to TaggedOutput.
[lcwik] Copy CloudObject to the Dataflow Module
[lcwik] [BEAM-1871] Remove deprecated org.apache.beam.sdk.options.GcsOptions
[kirpichov] Fixes javadoc of TextIO to not point to AvroIO
[kirpichov] Moves AvroSink to upper level
[kirpichov] Removes AvroIO.Read.Bound
[kirpichov] Adds AvroIO.readGenericRecords()
[kirpichov] Converts AvroIO.Read to AutoValue
[kirpichov] Removes AvroIO.Write.Bound
[kirpichov] Moves AvroIO.Read.withSchema into read()
[kirpichov] Converts AvroIO.Write to AutoValue; adds writeGenericRecords()
[kirpichov] Moves AvroIO.write().withSchema into write()
[kirpichov] Scattered minor improvements per review comments
[dhalperi] maptask_executor_runner_test: build fix
[lcwik] [BEAM-2005, BEAM-2030, BEAM-2031, BEAM-2032, BEAM-2033, BEAM-2070] Base
[lcwik] [BEAM-2005] Fix build break, ignore test due to change in
[lcwik] Remove aggregators from DoFn contexts and internal SDK usage
[dhalperi] [BEAM-59] Core tests: stop using gs:// paths
[dhalperi] [BEAM-59] TFRecordIOTest: cleanup
[dhalperi] [BEAM-59] DataflowRunnerTests: configure FileSystems in test
[dhalperi] [BEAM-59] AvroIOTest: use absolute paths for display data
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e92ead58cd661ff7ee952278f2983a578bdd2412 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e92ead58cd661ff7ee952278f2983a578bdd2412
> git rev-list b8131fe935d00db7f760b6410a4eb2239db1d25a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7353765744138912579.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5378899830644152793.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3104503862056589697.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6892438915894804756.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 06:00:32,557 3603e1c1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3603e1c1/pkb.log
2017-05-02 06:00:32,558 3603e1c1 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 06:00:32,558 3603e1c1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 06:00:32,904 3603e1c1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 06:00:32,994 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 06:00:32,997 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 06:00:32,997 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 06:00:33,002 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 06:00:33,004 3603e1c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 06:00:33,031 3603e1c1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 06:00:33,032 3603e1c1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3603e1c1/pkb.log
2017-05-02 06:00:33,032 3603e1c1 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/3603e1c1/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #361
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/361/display/redirect?page=changes>
Changes:
[klk] Do not repeat log messages in DataflowPipelineJob
[tgroh] Add A CoderTranslator Interface
[lcwik] Re-enable WindowedWordCountIT on Flink runner in precommit
[tgroh] Add Cloud Object Translators for Coders
[dhalperi] [BEAM-1676] Internalize ClassPath from Guava 21.0 to fix the failures
[lcwik] [BEAM-1871] Hide CloudResourceManager client in
[chamikara] [BEAM-1925] Remove deprecated context param from DoFn
[dhalperi] Remove IOChannelUtils from BigQuery TableRowWriter
[dhalperi] [BEAM-59] Switch mimeType from mutable protected field to constructor
[lcwik] Add CloudObjectTranslators for Avro, Serializable
[altay] [BEAM-1441] remove manual join from apiclient
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:809)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1076)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1107)
at hudson.scm.SCM.checkout(SCM.java:496)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1281)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1728)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:405)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*" returned status code 128:
stdout:
stderr: error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam1(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b8131fe935d00db7f760b6410a4eb2239db1d25a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b8131fe935d00db7f760b6410a4eb2239db1d25a
> git rev-list fe2a32000be87bbed1e8ae5a81a8e0368f0b0234 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6960404443284401470.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6555700586416662445.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6545264446819990109.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3892156480876229696.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-02 00:05:08,036 b3752e07 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b3752e07/pkb.log
2017-05-02 00:05:08,036 b3752e07 MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-02 00:05:08,036 b3752e07 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-02 00:05:08,480 b3752e07 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-02 00:05:08,569 b3752e07 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-02 00:05:08,571 b3752e07 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-02 00:05:08,572 b3752e07 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-02 00:05:08,577 b3752e07 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-02 00:05:08,586 b3752e07 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-02 00:05:08,605 b3752e07 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-02 00:05:08,605 b3752e07 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b3752e07/pkb.log
2017-05-02 00:05:08,606 b3752e07 MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/b3752e07/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #360
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/360/display/redirect?page=changes>
Changes:
[staslevin] [BEAM-2074,BEAM-2073] Fixed SourceDStream's rate control usage.
[lcwik] Use a new ReflectData for each AvroCoder instance
[lcwik] [BEAM-2130] Ensure the options id is never null.
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fe2a32000be87bbed1e8ae5a81a8e0368f0b0234 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fe2a32000be87bbed1e8ae5a81a8e0368f0b0234
> git rev-list 254470e626edb6a013ba5cb2d3312dc3bfbdcb51 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7363877203267415167.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5694443500676162576.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2268732869890752569.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7788084381097802984.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 18:00:12,066 e7cfe82e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/e7cfe82e/pkb.log
2017-05-01 18:00:12,066 e7cfe82e MainThread INFO PerfKitBenchmarker version: v1.11.0-47-gb38dddb
2017-05-01 18:00:12,066 e7cfe82e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 18:00:12,193 e7cfe82e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 18:00:12,280 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 18:00:12,282 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 18:00:12,282 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 18:00:12,288 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 543, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 459, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 18:00:12,290 e7cfe82e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 18:00:12,316 e7cfe82e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 18:00:12,317 e7cfe82e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/e7cfe82e/pkb.log
2017-05-01 18:00:12,317 e7cfe82e MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/e7cfe82e/completion_statuses.json
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #359
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/359/display/redirect?page=changes>
Changes:
[aviemzur] [BEAM-2129] Fix flaky KafkaIOTest#testUnboundedSourceMetrics
[staslevin] [BEAM-2072] Fixed MicrobatchSource.reader stops reading after reaching
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 254470e626edb6a013ba5cb2d3312dc3bfbdcb51 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 254470e626edb6a013ba5cb2d3312dc3bfbdcb51
> git rev-list 1197bef19b3ef974cdab39bd0468050586f17649 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6152341388469165452.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5067099177971037270.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6554058786833359081.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4784823925227759670.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 12:00:10,272 8eb5fb9e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/8eb5fb9e/pkb.log
2017-05-01 12:00:10,272 8eb5fb9e MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-05-01 12:00:10,273 8eb5fb9e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 12:00:10,444 8eb5fb9e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 12:00:10,554 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 12:00:10,556 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 12:00:10,557 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 12:00:10,562 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 12:00:10,564 8eb5fb9e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 12:00:10,585 8eb5fb9e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 12:00:10,585 8eb5fb9e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/8eb5fb9e/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #358
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/358/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Minor style cleanups to WriteOneWindowPerFile
[klk] Remove KeyedCombineFn
[klk] Update Dataflow worker version to beam-master-20170430
[dhalperi] [BEAM-59] DataflowRunner: Sink is always a FileBasedSink now
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1197bef19b3ef974cdab39bd0468050586f17649 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1197bef19b3ef974cdab39bd0468050586f17649
> git rev-list 46ca02aba5f4453b636e1c3eb799fca66cef9cfc # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7071712309772056122.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5333494622897297169.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5714470993083099562.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7610602714037543274.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 06:00:10,077 0ad3ea50 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/0ad3ea50/pkb.log
2017-05-01 06:00:10,077 0ad3ea50 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-05-01 06:00:10,078 0ad3ea50 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 06:00:10,272 0ad3ea50 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 06:00:10,358 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 06:00:10,360 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 06:00:10,360 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 06:00:10,366 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 06:00:10,368 0ad3ea50 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 06:00:10,393 0ad3ea50 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 06:00:10,393 0ad3ea50 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/0ad3ea50/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #357
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/357/display/redirect?page=changes>
Changes:
[dhalperi] Do not prune branches in Jenkins
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 46ca02aba5f4453b636e1c3eb799fca66cef9cfc (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 46ca02aba5f4453b636e1c3eb799fca66cef9cfc
> git rev-list a19ceaf47cbf6adddd755ee523141c88bbc53f05 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3701123732946005273.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8305364138761762006.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4622022496640876743.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4157783115163909445.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-05-01 00:00:09,649 dd94e0d2 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/dd94e0d2/pkb.log
2017-05-01 00:00:09,649 dd94e0d2 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-05-01 00:00:09,650 dd94e0d2 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-05-01 00:00:10,307 dd94e0d2 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-05-01 00:00:10,390 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-05-01 00:00:10,397 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-05-01 00:00:10,398 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-05-01 00:00:10,404 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-05-01 00:00:10,446 dd94e0d2 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-05-01 00:00:10,477 dd94e0d2 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-05-01 00:00:10,478 dd94e0d2 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/dd94e0d2/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #356
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/356/display/redirect?page=changes>
Changes:
[thw] BEAM-2022 fix triggering for processing time timers
[kirpichov] [BEAM-2114] Fixed display data for Kafka read/write with coders
[kirpichov] [BEAM-2114] Throw instead of warning when KafkaIO cannot infer coder
[kirpichov] [BEAM-2114] Tests for KafkaIO: use ExpectedException rule
[iemejia] Fix hamcrest-core version in parent pom
------------------------------------------
[...truncated 244.20 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a19ceaf47cbf6adddd755ee523141c88bbc53f05 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a19ceaf47cbf6adddd755ee523141c88bbc53f05
> git rev-list fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1845648802584385833.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5289481183229827751.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5305735820570203269.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3437877643927861753.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 18:03:08,543 a3d92479 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/a3d92479/pkb.log
2017-04-30 18:03:08,543 a3d92479 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 18:03:08,544 a3d92479 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 18:03:09,001 a3d92479 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 18:03:09,092 a3d92479 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 18:03:09,094 a3d92479 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 18:03:09,095 a3d92479 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 18:03:09,100 a3d92479 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 18:03:09,102 a3d92479 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 18:03:09,126 a3d92479 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 18:03:09,127 a3d92479 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/a3d92479/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #355
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/355/display/redirect>
------------------------------------------
[...truncated 275.61 KB...]
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
* [new ref] refs/pull/2783/head -> origin/pr/2783/head
* [new ref] refs/pull/2783/merge -> origin/pr/2783/merge
* [new ref] refs/pull/2784/head -> origin/pr/2784/head
* [new ref] refs/pull/2784/merge -> origin/pr/2784/merge
* [new ref] refs/pull/2785/head -> origin/pr/2785/head
* [new ref] refs/pull/2785/merge -> origin/pr/2785/merge
* [new ref] refs/pull/2786/head -> origin/pr/2786/head
* [new ref] refs/pull/2786/merge -> origin/pr/2786/merge
* [new ref] refs/pull/2787/head -> origin/pr/2787/head
* [new ref] refs/pull/2787/merge -> origin/pr/2787/merge
* [new ref] refs/pull/2788/head -> origin/pr/2788/head
* [new ref] refs/pull/2788/merge -> origin/pr/2788/merge
* [new ref] refs/pull/2789/head -> origin/pr/2789/head
* [new ref] refs/pull/2789/merge -> origin/pr/2789/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fc55d2f811a57d25e8d1e5f204d9a07e2c50a370
> git rev-list fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7453968279601938384.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8885442801494115696.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6183792721343274824.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson510426867877615601.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 12:03:45,742 d2074a0c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d2074a0c/pkb.log
2017-04-30 12:03:45,742 d2074a0c MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 12:03:45,743 d2074a0c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 12:03:45,953 d2074a0c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 12:03:46,039 d2074a0c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 12:03:46,041 d2074a0c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 12:03:46,041 d2074a0c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 12:03:46,047 d2074a0c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 12:03:46,049 d2074a0c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 12:03:46,076 d2074a0c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 12:03:46,076 d2074a0c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d2074a0c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #354
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/354/display/redirect?page=changes>
Changes:
[lcwik] Remove useless return statement
[lcwik] Remove redundant private on enum constructors
[lcwik] Remove useless continue statements
------------------------------------------
[...truncated 279.34 KB...]
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
* [new ref] refs/pull/2783/head -> origin/pr/2783/head
* [new ref] refs/pull/2783/merge -> origin/pr/2783/merge
* [new ref] refs/pull/2784/head -> origin/pr/2784/head
* [new ref] refs/pull/2784/merge -> origin/pr/2784/merge
* [new ref] refs/pull/2785/head -> origin/pr/2785/head
* [new ref] refs/pull/2785/merge -> origin/pr/2785/merge
* [new ref] refs/pull/2786/head -> origin/pr/2786/head
* [new ref] refs/pull/2786/merge -> origin/pr/2786/merge
* [new ref] refs/pull/2787/head -> origin/pr/2787/head
* [new ref] refs/pull/2787/merge -> origin/pr/2787/merge
* [new ref] refs/pull/2788/head -> origin/pr/2788/head
* [new ref] refs/pull/2788/merge -> origin/pr/2788/merge
* [new ref] refs/pull/2789/head -> origin/pr/2789/head
* [new ref] refs/pull/2789/merge -> origin/pr/2789/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fc55d2f811a57d25e8d1e5f204d9a07e2c50a370 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fc55d2f811a57d25e8d1e5f204d9a07e2c50a370
> git rev-list 14d60b26e7e9b8a578038599341e66ccd99d012b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6862909983330959471.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4580765514315349282.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5721452976460685433.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3975592660729805138.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 06:03:56,700 138e2101 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/138e2101/pkb.log
2017-04-30 06:03:56,700 138e2101 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 06:03:56,702 138e2101 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 06:03:57,053 138e2101 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 06:03:57,167 138e2101 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 06:03:57,169 138e2101 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 06:03:57,170 138e2101 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 06:03:57,177 138e2101 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 06:03:57,179 138e2101 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 06:03:57,197 138e2101 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 06:03:57,198 138e2101 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/138e2101/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #353
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/353/display/redirect?page=changes>
Changes:
[klk] Move stable name validation to Pipeline.run()
[klk] Remove PipelineOptions from createWriteOperation()
[klk] Move PTransform.validate to post-construction, modulo BigQueryIO
[klk] Supply PipelineOptions at Pipeline.run()
[kirpichov] Converts PubsubIO.Read to AutoValue
[kirpichov] Renames PubsubIO.Read builder methods to be style guide compliant
[kirpichov] Remove override of topic by subscription and vice versa
[kirpichov] Converts PubsubIO.Write to AutoValue
[kirpichov] Renames PubsubIO.Write builder methods to be style guide compliant
[kirpichov] Adds PubsubIO.readStrings(), readProtos(), readAvros()
[kirpichov] Adds PubsubIO.writeStrings(), writeProtos(), writeAvros()
[kirpichov] Renames {id,timestamp}Label to {id,timestamp}Attribute throughout SDK
------------------------------------------
[...truncated 277.08 KB...]
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
* [new ref] refs/pull/2783/head -> origin/pr/2783/head
* [new ref] refs/pull/2783/merge -> origin/pr/2783/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 14d60b26e7e9b8a578038599341e66ccd99d012b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 14d60b26e7e9b8a578038599341e66ccd99d012b
> git rev-list be883666f377b29926cc1e7408d7cd268ca6ceff # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8367195479928485348.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3089505677135875789.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3553683777749011579.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4294483275160305081.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-30 00:03:26,437 08e803bf MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/08e803bf/pkb.log
2017-04-30 00:03:26,437 08e803bf MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-30 00:03:26,438 08e803bf MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-30 00:03:26,562 08e803bf MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-30 00:03:26,655 08e803bf MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-30 00:03:26,658 08e803bf MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-30 00:03:26,658 08e803bf MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-30 00:03:26,665 08e803bf MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-30 00:03:26,668 08e803bf MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-30 00:03:26,684 08e803bf MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-30 00:03:26,685 08e803bf MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/08e803bf/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #352
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/352/display/redirect?page=changes>
Changes:
[aviemzur] Fix broken build
[aviemzur] [BEAM-2057] Add a test for metrics reporting in Spark runner.
[aviemzur] [BEAM-1398] KafkaIO metrics.
[lcwik] [BEAM-1871] Hide internal implementation details of how we create a
[lcwik] [BEAM-2098] Walkthrough URL in example code Javadoc is 404 not found
------------------------------------------
[...truncated 272.56 KB...]
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2782/head -> origin/pr/2782/head
* [new ref] refs/pull/2782/merge -> origin/pr/2782/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision be883666f377b29926cc1e7408d7cd268ca6ceff (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f be883666f377b29926cc1e7408d7cd268ca6ceff
> git rev-list 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4745471857012938703.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6358110927967500065.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8940889086758308405.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3378038771597517468.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 18:03:49,527 bb4cfe9b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bb4cfe9b/pkb.log
2017-04-29 18:03:49,527 bb4cfe9b MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 18:03:49,528 bb4cfe9b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 18:03:49,751 bb4cfe9b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 18:03:49,894 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 18:03:49,897 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 18:03:49,897 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 18:03:49,904 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 18:03:49,906 bb4cfe9b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 18:03:49,918 bb4cfe9b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 18:03:49,919 bb4cfe9b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bb4cfe9b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #351
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/351/display/redirect>
------------------------------------------
[...truncated 275.47 KB...]
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
* [new ref] refs/pull/2780/head -> origin/pr/2780/head
* [new ref] refs/pull/2780/merge -> origin/pr/2780/merge
* [new ref] refs/pull/2781/head -> origin/pr/2781/head
* [new ref] refs/pull/2781/merge -> origin/pr/2781/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7
> git rev-list 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5610768077729537594.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2140599300260081637.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3098636546658275577.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2183055372966426644.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 12:02:56,991 71421fca MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/71421fca/pkb.log
2017-04-29 12:02:56,992 71421fca MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 12:02:56,992 71421fca MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 12:02:57,205 71421fca MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 12:02:57,299 71421fca MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 12:02:57,302 71421fca MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 12:02:57,302 71421fca MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 12:02:57,309 71421fca MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 12:02:57,311 71421fca MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 12:02:57,333 71421fca MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 12:02:57,334 71421fca MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/71421fca/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #350
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/350/display/redirect?page=changes>
Changes:
[tgroh] Java-Serialize Coders Directly
[tgroh] Use Runner API Encodings in the Fn API
------------------------------------------
[...truncated 276.76 KB...]
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2766/head -> origin/pr/2766/head
* [new ref] refs/pull/2766/merge -> origin/pr/2766/merge
* [new ref] refs/pull/2767/head -> origin/pr/2767/head
* [new ref] refs/pull/2767/merge -> origin/pr/2767/merge
* [new ref] refs/pull/2768/head -> origin/pr/2768/head
* [new ref] refs/pull/2768/merge -> origin/pr/2768/merge
* [new ref] refs/pull/2769/head -> origin/pr/2769/head
* [new ref] refs/pull/2769/merge -> origin/pr/2769/merge
* [new ref] refs/pull/2770/head -> origin/pr/2770/head
* [new ref] refs/pull/2770/merge -> origin/pr/2770/merge
* [new ref] refs/pull/2771/head -> origin/pr/2771/head
* [new ref] refs/pull/2771/merge -> origin/pr/2771/merge
* [new ref] refs/pull/2772/head -> origin/pr/2772/head
* [new ref] refs/pull/2772/merge -> origin/pr/2772/merge
* [new ref] refs/pull/2773/head -> origin/pr/2773/head
* [new ref] refs/pull/2773/merge -> origin/pr/2773/merge
* [new ref] refs/pull/2774/head -> origin/pr/2774/head
* [new ref] refs/pull/2774/merge -> origin/pr/2774/merge
* [new ref] refs/pull/2775/head -> origin/pr/2775/head
* [new ref] refs/pull/2775/merge -> origin/pr/2775/merge
* [new ref] refs/pull/2776/head -> origin/pr/2776/head
* [new ref] refs/pull/2776/merge -> origin/pr/2776/merge
* [new ref] refs/pull/2777/head -> origin/pr/2777/head
* [new ref] refs/pull/2777/merge -> origin/pr/2777/merge
* [new ref] refs/pull/2778/head -> origin/pr/2778/head
* [new ref] refs/pull/2778/merge -> origin/pr/2778/merge
* [new ref] refs/pull/2779/head -> origin/pr/2779/head
* [new ref] refs/pull/2779/merge -> origin/pr/2779/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1866)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1585)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:71)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:348)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1545)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:830)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor788.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:807)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2b6cb8ca17a8a87aa9db2e5725f018ef564f27d7
> git rev-list 8cc4d59c2f617746228ae71f7c9b3606ab41d4aa # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson575957050051838022.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4536196834838176277.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4461022084672753065.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2123489805330147213.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 06:03:00,455 12fcd3a7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/12fcd3a7/pkb.log
2017-04-29 06:03:00,455 12fcd3a7 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 06:03:00,455 12fcd3a7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 06:03:00,806 12fcd3a7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 06:03:00,893 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 06:03:00,896 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 06:03:00,896 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 06:03:00,903 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 06:03:00,905 12fcd3a7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 06:03:00,928 12fcd3a7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 06:03:00,929 12fcd3a7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/12fcd3a7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #349
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/349/display/redirect?page=changes>
Changes:
[thw] BEAM-1981 Fix ApexTimerInternals serialization error.
[lcwik] [BEAM-2119] Fix FileSystems to have the local filesystem installed by
[dhalperi] ResourceId: Add #isDirectory
[dhalperi] TextIOTest: shrink size of test data
[dhalperi] Remove IOChannelUtils from a few ITs
[dhalperi] Use getFileName in NumberedShardedFile
[dhalperi] [BEAM-2114] Wrap inferred KafkaIO Coders with NullableCoder
[lcwik] [BEAM-2031] Add support to pass through zero or more Hadoop
[davor] Retire Travis-CI coverage in Apache Beam
[klk] Rollforwards "Replace OutputTimeFn UDF with TimestampCombiner enum""
[klk] Update Dataflow worker container to 20170428-2
[lcwik] [BEAM-2005] Swap to use Lists within MatchResult instead of arrays.
[tgroh] Rename StandardCoder to StructuredCoder
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam3 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8cc4d59c2f617746228ae71f7c9b3606ab41d4aa (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8cc4d59c2f617746228ae71f7c9b3606ab41d4aa
> git rev-list a8a04a2905e1ff639f403be7d9132acb77365e84 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8165256925489934285.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5977251568187376076.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7413298209517419532.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7237457073097871041.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-29 03:13:57,597 4369b025 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/4369b025/pkb.log
2017-04-29 03:13:57,597 4369b025 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-29 03:13:57,598 4369b025 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-29 03:13:58,134 4369b025 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-29 03:13:58,237 4369b025 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-29 03:13:58,240 4369b025 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-29 03:13:58,240 4369b025 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-29 03:13:58,246 4369b025 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-29 03:13:58,248 4369b025 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-29 03:13:58,253 4369b025 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-29 03:13:58,254 4369b025 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/4369b025/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #348
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/348/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-1871] Remove irrelevant runtime dependencies.
[lcwik] [BEAM-2005] Move getScheme from FileSystemRegistrar to FileSystem
[iemejia] Remove missing references to the flink examples package after refactor
[altay] [BEAM-2094] WordCount examples produce garbage for non-English input
[davor] Fix Javadoc warnings
[dhalperi] Add getFilename method to ResourceId
------------------------------------------
[...truncated 278.83 KB...]
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
* [new ref] refs/pull/2760/head -> origin/pr/2760/head
* [new ref] refs/pull/2760/merge -> origin/pr/2760/merge
* [new ref] refs/pull/2761/head -> origin/pr/2761/head
* [new ref] refs/pull/2761/merge -> origin/pr/2761/merge
* [new ref] refs/pull/2762/head -> origin/pr/2762/head
* [new ref] refs/pull/2762/merge -> origin/pr/2762/merge
* [new ref] refs/pull/2763/head -> origin/pr/2763/head
* [new ref] refs/pull/2763/merge -> origin/pr/2763/merge
* [new ref] refs/pull/2764/head -> origin/pr/2764/head
* [new ref] refs/pull/2764/merge -> origin/pr/2764/merge
* [new ref] refs/pull/2765/head -> origin/pr/2765/head
* [new ref] refs/pull/2765/merge -> origin/pr/2765/merge
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! c340815...7db1c72 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a8a04a2905e1ff639f403be7d9132acb77365e84 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a8a04a2905e1ff639f403be7d9132acb77365e84
> git rev-list 47aaf11250e61d61c0bb3616063dbd5b7f2adb88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4564722808097325418.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7314216211457396990.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2895089141881926520.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1619236758377138686.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 18:03:53,919 b587cc76 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b587cc76/pkb.log
2017-04-28 18:03:53,920 b587cc76 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 18:03:53,920 b587cc76 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 18:03:54,167 b587cc76 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 18:03:54,252 b587cc76 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 18:03:54,254 b587cc76 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 18:03:54,254 b587cc76 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 18:03:54,259 b587cc76 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 18:03:54,261 b587cc76 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 18:03:54,289 b587cc76 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 18:03:54,289 b587cc76 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b587cc76/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #347
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/347/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Remove IOChannelFactory usage from
------------------------------------------
[...truncated 274.58 KB...]
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
* [new ref] refs/pull/2759/head -> origin/pr/2759/head
* [new ref] refs/pull/2759/merge -> origin/pr/2759/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 47aaf11250e61d61c0bb3616063dbd5b7f2adb88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 47aaf11250e61d61c0bb3616063dbd5b7f2adb88
> git rev-list 185dc47982078124abf6e851ad1c66ebc4ae8c54 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson237869347449738261.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1892242311269932473.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3470559880167990717.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9059110588875269546.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 12:03:03,070 d98aca1b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d98aca1b/pkb.log
2017-04-28 12:03:03,070 d98aca1b MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 12:03:03,071 d98aca1b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 12:03:03,431 d98aca1b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 12:03:03,519 d98aca1b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 12:03:03,522 d98aca1b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 12:03:03,522 d98aca1b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 12:03:03,527 d98aca1b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 12:03:03,529 d98aca1b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 12:03:03,553 d98aca1b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 12:03:03,553 d98aca1b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d98aca1b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #346
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/346/display/redirect?page=changes>
Changes:
[dhalperi] WriteFiles: trivial message fix
[altay] Add a simple snippet for a composite transform.
[lcwik] [BEAM-2031] Add support to PipelineOptionsFactory/ProxyInvocationHandler
------------------------------------------
[...truncated 278.41 KB...]
* [new ref] refs/pull/2687/merge -> origin/pr/2687/merge
* [new ref] refs/pull/2688/head -> origin/pr/2688/head
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2756/head -> origin/pr/2756/head
* [new ref] refs/pull/2756/merge -> origin/pr/2756/merge
* [new ref] refs/pull/2757/head -> origin/pr/2757/head
* [new ref] refs/pull/2757/merge -> origin/pr/2757/merge
* [new ref] refs/pull/2758/head -> origin/pr/2758/head
* [new ref] refs/pull/2758/merge -> origin/pr/2758/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 185dc47982078124abf6e851ad1c66ebc4ae8c54 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 185dc47982078124abf6e851ad1c66ebc4ae8c54
> git rev-list f71395bfd8f94cbe8d78098f5bb66a1dce65e74b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7629065342476446863.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5164883115491144609.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5434082747574129193.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3907632445143274954.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 06:03:23,260 b10f0b95 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b10f0b95/pkb.log
2017-04-28 06:03:23,261 b10f0b95 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 06:03:23,261 b10f0b95 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 06:03:23,893 b10f0b95 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 06:03:23,993 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 06:03:23,996 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 06:03:23,996 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 06:03:24,001 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 06:03:24,003 b10f0b95 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 06:03:24,032 b10f0b95 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 06:03:24,032 b10f0b95 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b10f0b95/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #345
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/345/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] LocalResources: helper utility to create LocalResourceId
------------------------------------------
[...truncated 335.14 KB...]
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
* [new ref] refs/pull/2745/head -> origin/pr/2745/head
* [new ref] refs/pull/2745/merge -> origin/pr/2745/merge
* [new ref] refs/pull/2746/head -> origin/pr/2746/head
* [new ref] refs/pull/2746/merge -> origin/pr/2746/merge
* [new ref] refs/pull/2747/head -> origin/pr/2747/head
* [new ref] refs/pull/2747/merge -> origin/pr/2747/merge
* [new ref] refs/pull/2748/head -> origin/pr/2748/head
* [new ref] refs/pull/2748/merge -> origin/pr/2748/merge
* [new ref] refs/pull/2749/head -> origin/pr/2749/head
* [new ref] refs/pull/2749/merge -> origin/pr/2749/merge
* [new ref] refs/pull/2750/head -> origin/pr/2750/head
* [new ref] refs/pull/2750/merge -> origin/pr/2750/merge
* [new ref] refs/pull/2751/head -> origin/pr/2751/head
* [new ref] refs/pull/2751/merge -> origin/pr/2751/merge
* [new ref] refs/pull/2752/head -> origin/pr/2752/head
* [new ref] refs/pull/2752/merge -> origin/pr/2752/merge
* [new ref] refs/pull/2753/head -> origin/pr/2753/head
* [new ref] refs/pull/2753/merge -> origin/pr/2753/merge
* [new ref] refs/pull/2754/head -> origin/pr/2754/head
* [new ref] refs/pull/2754/merge -> origin/pr/2754/merge
* [new ref] refs/pull/2755/head -> origin/pr/2755/head
* [new ref] refs/pull/2755/merge -> origin/pr/2755/merge
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! 33b68a2...f9612e3 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 7129de6...0d9a8ae refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/871/merge: No such file or directory
! 61f4dd5...dcc5b0b refs/pull/871/merge -> origin/pr/871/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/886/merge: No such file or directory
! 01f16da...9fe583c refs/pull/886/merge -> origin/pr/886/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! c0c0a26...c340815 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/902/merge: No such file or directory
! 38d7315...824f162 refs/pull/902/merge -> origin/pr/902/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/914/merge: No such file or directory
! 3c4444a...b93dd41 refs/pull/914/merge -> origin/pr/914/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/917/merge: No such file or directory
! 7db5e68...b264c75 refs/pull/917/merge -> origin/pr/917/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/959/merge: No such file or directory
! 39c9afa...25d5f19 refs/pull/959/merge -> origin/pr/959/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/984/merge: No such file or directory
! 54fa2a8...da83b57 refs/pull/984/merge -> origin/pr/984/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f71395bfd8f94cbe8d78098f5bb66a1dce65e74b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f71395bfd8f94cbe8d78098f5bb66a1dce65e74b
> git rev-list a46eb1a80074dc9c382da4d71725ffc61f2e65ba # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8414838313204931955.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2274779365146555086.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson126783067219510162.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1619822904534489164.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-28 00:16:41,181 3baf5fc3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3baf5fc3/pkb.log
2017-04-28 00:16:41,181 3baf5fc3 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-28 00:16:41,182 3baf5fc3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-28 00:16:41,459 3baf5fc3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-28 00:16:41,579 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-28 00:16:41,581 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-28 00:16:41,582 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-28 00:16:41,588 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-28 00:16:41,590 3baf5fc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-28 00:16:41,616 3baf5fc3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-28 00:16:41,616 3baf5fc3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3baf5fc3/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #344
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/344/display/redirect?page=changes>
Changes:
[tgroh] Remove Coder Encoding IDs
[dhalperi] [BEAM-2029] NullPointerException when using multi output ParDo in Spark
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a46eb1a80074dc9c382da4d71725ffc61f2e65ba (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a46eb1a80074dc9c382da4d71725ffc61f2e65ba
> git rev-list 14a90d7c5196d96de66e897687d28202d790439f # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8954828005480798397.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7600906786718259233.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7565460630655822730.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2039476742967189830.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 23:08:54,432 1990bb3b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/1990bb3b/pkb.log
2017-04-27 23:08:54,433 1990bb3b MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 23:08:54,433 1990bb3b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 23:08:54,782 1990bb3b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 23:08:54,892 1990bb3b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 23:08:54,894 1990bb3b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 23:08:54,894 1990bb3b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 23:08:54,899 1990bb3b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 23:08:54,906 1990bb3b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 23:08:54,926 1990bb3b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 23:08:54,927 1990bb3b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/1990bb3b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #343
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/343/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Add FileSystems#matchNewResource
------------------------------------------
[...truncated 226.76 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam7(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 14a90d7c5196d96de66e897687d28202d790439f (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 14a90d7c5196d96de66e897687d28202d790439f
> git rev-list fdf2de9994268f5e1d704aa30a4504ac6ee624b8 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2015906685247531260.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6969306375109267709.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2093116221770561675.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7146861158317934605.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 22:00:01,523 b1eb7fb8 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b1eb7fb8/pkb.log
2017-04-27 22:00:01,523 b1eb7fb8 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 22:00:01,524 b1eb7fb8 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 22:00:01,704 b1eb7fb8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 22:00:01,830 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 22:00:01,834 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 22:00:01,834 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 22:00:01,842 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 22:00:01,846 b1eb7fb8 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 22:00:01,915 b1eb7fb8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 22:00:01,916 b1eb7fb8 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b1eb7fb8/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #342
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/342/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-2096] Make DataflowMetrics more resilient
------------------------------------------
[...truncated 272.22 KB...]
* [new ref] refs/pull/2671/merge -> origin/pr/2671/merge
* [new ref] refs/pull/2672/head -> origin/pr/2672/head
* [new ref] refs/pull/2673/head -> origin/pr/2673/head
* [new ref] refs/pull/2673/merge -> origin/pr/2673/merge
* [new ref] refs/pull/2674/head -> origin/pr/2674/head
* [new ref] refs/pull/2675/head -> origin/pr/2675/head
* [new ref] refs/pull/2676/head -> origin/pr/2676/head
* [new ref] refs/pull/2676/merge -> origin/pr/2676/merge
* [new ref] refs/pull/2677/head -> origin/pr/2677/head
* [new ref] refs/pull/2678/head -> origin/pr/2678/head
* [new ref] refs/pull/2678/merge -> origin/pr/2678/merge
* [new ref] refs/pull/2679/head -> origin/pr/2679/head
* [new ref] refs/pull/2679/merge -> origin/pr/2679/merge
* [new ref] refs/pull/2680/head -> origin/pr/2680/head
* [new ref] refs/pull/2680/merge -> origin/pr/2680/merge
* [new ref] refs/pull/2681/head -> origin/pr/2681/head
* [new ref] refs/pull/2681/merge -> origin/pr/2681/merge
* [new ref] refs/pull/2682/head -> origin/pr/2682/head
* [new ref] refs/pull/2682/merge -> origin/pr/2682/merge
* [new ref] refs/pull/2683/head -> origin/pr/2683/head
* [new ref] refs/pull/2684/head -> origin/pr/2684/head
* [new ref] refs/pull/2685/head -> origin/pr/2685/head
* [new ref] refs/pull/2685/merge -> origin/pr/2685/merge
* [new ref] refs/pull/2686/head -> origin/pr/2686/head
* [new ref] refs/pull/2686/merge -> origin/pr/2686/merge
* [new ref] refs/pull/2687/head -> origin/pr/2687/head
* [new ref] refs/pull/2687/merge -> origin/pr/2687/merge
* [new ref] refs/pull/2688/head -> origin/pr/2688/head
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2728/merge -> origin/pr/2728/merge
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fdf2de9994268f5e1d704aa30a4504ac6ee624b8 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fdf2de9994268f5e1d704aa30a4504ac6ee624b8
> git rev-list 884935cb98f0e29bd965fda9182970423d111d7e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1481056550875902878.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7057979296962581930.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1649567276947638519.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4082715966327646198.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 20:26:33,447 b639e0e6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b639e0e6/pkb.log
2017-04-27 20:26:33,447 b639e0e6 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 20:26:33,448 b639e0e6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 20:26:33,625 b639e0e6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 20:26:33,723 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 20:26:33,726 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 20:26:33,727 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 20:26:33,735 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 20:26:33,738 b639e0e6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 20:26:33,753 b639e0e6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 20:26:33,753 b639e0e6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b639e0e6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #341
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/341/display/redirect?page=changes>
Changes:
[altay] [BEAM-1695] Improve Python-SDK's programming guide
------------------------------------------
[...truncated 309.18 KB...]
* [new ref] refs/pull/2673/head -> origin/pr/2673/head
* [new ref] refs/pull/2673/merge -> origin/pr/2673/merge
* [new ref] refs/pull/2674/head -> origin/pr/2674/head
* [new ref] refs/pull/2675/head -> origin/pr/2675/head
* [new ref] refs/pull/2676/head -> origin/pr/2676/head
* [new ref] refs/pull/2676/merge -> origin/pr/2676/merge
* [new ref] refs/pull/2677/head -> origin/pr/2677/head
* [new ref] refs/pull/2678/head -> origin/pr/2678/head
* [new ref] refs/pull/2678/merge -> origin/pr/2678/merge
* [new ref] refs/pull/2679/head -> origin/pr/2679/head
* [new ref] refs/pull/2679/merge -> origin/pr/2679/merge
* [new ref] refs/pull/2680/head -> origin/pr/2680/head
* [new ref] refs/pull/2680/merge -> origin/pr/2680/merge
* [new ref] refs/pull/2681/head -> origin/pr/2681/head
* [new ref] refs/pull/2681/merge -> origin/pr/2681/merge
* [new ref] refs/pull/2682/head -> origin/pr/2682/head
* [new ref] refs/pull/2682/merge -> origin/pr/2682/merge
* [new ref] refs/pull/2683/head -> origin/pr/2683/head
* [new ref] refs/pull/2684/head -> origin/pr/2684/head
* [new ref] refs/pull/2685/head -> origin/pr/2685/head
* [new ref] refs/pull/2685/merge -> origin/pr/2685/merge
* [new ref] refs/pull/2686/head -> origin/pr/2686/head
* [new ref] refs/pull/2686/merge -> origin/pr/2686/merge
* [new ref] refs/pull/2687/head -> origin/pr/2687/head
* [new ref] refs/pull/2687/merge -> origin/pr/2687/merge
* [new ref] refs/pull/2688/head -> origin/pr/2688/head
* [new ref] refs/pull/2688/merge -> origin/pr/2688/merge
* [new ref] refs/pull/2689/head -> origin/pr/2689/head
* [new ref] refs/pull/2689/merge -> origin/pr/2689/merge
* [new ref] refs/pull/2690/head -> origin/pr/2690/head
* [new ref] refs/pull/2690/merge -> origin/pr/2690/merge
* [new ref] refs/pull/2691/head -> origin/pr/2691/head
* [new ref] refs/pull/2691/merge -> origin/pr/2691/merge
* [new ref] refs/pull/2692/head -> origin/pr/2692/head
* [new ref] refs/pull/2692/merge -> origin/pr/2692/merge
* [new ref] refs/pull/2693/head -> origin/pr/2693/head
* [new ref] refs/pull/2693/merge -> origin/pr/2693/merge
* [new ref] refs/pull/2694/head -> origin/pr/2694/head
* [new ref] refs/pull/2694/merge -> origin/pr/2694/merge
* [new ref] refs/pull/2695/head -> origin/pr/2695/head
* [new ref] refs/pull/2695/merge -> origin/pr/2695/merge
* [new ref] refs/pull/2696/head -> origin/pr/2696/head
* [new ref] refs/pull/2696/merge -> origin/pr/2696/merge
* [new ref] refs/pull/2697/head -> origin/pr/2697/head
* [new ref] refs/pull/2697/merge -> origin/pr/2697/merge
* [new ref] refs/pull/2698/head -> origin/pr/2698/head
* [new ref] refs/pull/2698/merge -> origin/pr/2698/merge
* [new ref] refs/pull/2699/head -> origin/pr/2699/head
* [new ref] refs/pull/2699/merge -> origin/pr/2699/merge
* [new ref] refs/pull/2700/head -> origin/pr/2700/head
* [new ref] refs/pull/2700/merge -> origin/pr/2700/merge
* [new ref] refs/pull/2701/head -> origin/pr/2701/head
* [new ref] refs/pull/2701/merge -> origin/pr/2701/merge
* [new ref] refs/pull/2702/head -> origin/pr/2702/head
* [new ref] refs/pull/2702/merge -> origin/pr/2702/merge
* [new ref] refs/pull/2703/head -> origin/pr/2703/head
* [new ref] refs/pull/2703/merge -> origin/pr/2703/merge
* [new ref] refs/pull/2704/head -> origin/pr/2704/head
* [new ref] refs/pull/2704/merge -> origin/pr/2704/merge
* [new ref] refs/pull/2705/head -> origin/pr/2705/head
* [new ref] refs/pull/2705/merge -> origin/pr/2705/merge
* [new ref] refs/pull/2706/head -> origin/pr/2706/head
* [new ref] refs/pull/2707/head -> origin/pr/2707/head
* [new ref] refs/pull/2707/merge -> origin/pr/2707/merge
* [new ref] refs/pull/2708/head -> origin/pr/2708/head
* [new ref] refs/pull/2708/merge -> origin/pr/2708/merge
* [new ref] refs/pull/2709/head -> origin/pr/2709/head
* [new ref] refs/pull/2709/merge -> origin/pr/2709/merge
* [new ref] refs/pull/2710/head -> origin/pr/2710/head
* [new ref] refs/pull/2710/merge -> origin/pr/2710/merge
* [new ref] refs/pull/2711/head -> origin/pr/2711/head
* [new ref] refs/pull/2711/merge -> origin/pr/2711/merge
* [new ref] refs/pull/2712/head -> origin/pr/2712/head
* [new ref] refs/pull/2712/merge -> origin/pr/2712/merge
* [new ref] refs/pull/2713/head -> origin/pr/2713/head
* [new ref] refs/pull/2713/merge -> origin/pr/2713/merge
* [new ref] refs/pull/2714/head -> origin/pr/2714/head
* [new ref] refs/pull/2714/merge -> origin/pr/2714/merge
* [new ref] refs/pull/2715/head -> origin/pr/2715/head
* [new ref] refs/pull/2715/merge -> origin/pr/2715/merge
* [new ref] refs/pull/2716/head -> origin/pr/2716/head
* [new ref] refs/pull/2716/merge -> origin/pr/2716/merge
* [new ref] refs/pull/2717/head -> origin/pr/2717/head
* [new ref] refs/pull/2717/merge -> origin/pr/2717/merge
* [new ref] refs/pull/2718/head -> origin/pr/2718/head
* [new ref] refs/pull/2718/merge -> origin/pr/2718/merge
* [new ref] refs/pull/2719/head -> origin/pr/2719/head
* [new ref] refs/pull/2719/merge -> origin/pr/2719/merge
* [new ref] refs/pull/2720/head -> origin/pr/2720/head
* [new ref] refs/pull/2720/merge -> origin/pr/2720/merge
* [new ref] refs/pull/2721/head -> origin/pr/2721/head
* [new ref] refs/pull/2721/merge -> origin/pr/2721/merge
* [new ref] refs/pull/2722/head -> origin/pr/2722/head
* [new ref] refs/pull/2722/merge -> origin/pr/2722/merge
* [new ref] refs/pull/2723/head -> origin/pr/2723/head
* [new ref] refs/pull/2723/merge -> origin/pr/2723/merge
* [new ref] refs/pull/2724/head -> origin/pr/2724/head
* [new ref] refs/pull/2724/merge -> origin/pr/2724/merge
* [new ref] refs/pull/2725/head -> origin/pr/2725/head
* [new ref] refs/pull/2726/head -> origin/pr/2726/head
* [new ref] refs/pull/2727/head -> origin/pr/2727/head
* [new ref] refs/pull/2727/merge -> origin/pr/2727/merge
* [new ref] refs/pull/2728/head -> origin/pr/2728/head
* [new ref] refs/pull/2728/merge -> origin/pr/2728/merge
* [new ref] refs/pull/2729/head -> origin/pr/2729/head
* [new ref] refs/pull/2729/merge -> origin/pr/2729/merge
* [new ref] refs/pull/2730/head -> origin/pr/2730/head
* [new ref] refs/pull/2730/merge -> origin/pr/2730/merge
* [new ref] refs/pull/2731/head -> origin/pr/2731/head
* [new ref] refs/pull/2732/head -> origin/pr/2732/head
* [new ref] refs/pull/2732/merge -> origin/pr/2732/merge
* [new ref] refs/pull/2733/head -> origin/pr/2733/head
* [new ref] refs/pull/2733/merge -> origin/pr/2733/merge
* [new ref] refs/pull/2734/head -> origin/pr/2734/head
* [new ref] refs/pull/2734/merge -> origin/pr/2734/merge
* [new ref] refs/pull/2735/head -> origin/pr/2735/head
* [new ref] refs/pull/2735/merge -> origin/pr/2735/merge
* [new ref] refs/pull/2736/head -> origin/pr/2736/head
* [new ref] refs/pull/2736/merge -> origin/pr/2736/merge
* [new ref] refs/pull/2737/head -> origin/pr/2737/head
* [new ref] refs/pull/2737/merge -> origin/pr/2737/merge
* [new ref] refs/pull/2738/head -> origin/pr/2738/head
* [new ref] refs/pull/2738/merge -> origin/pr/2738/merge
* [new ref] refs/pull/2739/head -> origin/pr/2739/head
* [new ref] refs/pull/2739/merge -> origin/pr/2739/merge
* [new ref] refs/pull/2740/head -> origin/pr/2740/head
* [new ref] refs/pull/2740/merge -> origin/pr/2740/merge
* [new ref] refs/pull/2741/head -> origin/pr/2741/head
* [new ref] refs/pull/2741/merge -> origin/pr/2741/merge
* [new ref] refs/pull/2742/head -> origin/pr/2742/head
* [new ref] refs/pull/2743/head -> origin/pr/2743/head
* [new ref] refs/pull/2743/merge -> origin/pr/2743/merge
* [new ref] refs/pull/2744/head -> origin/pr/2744/head
* [new ref] refs/pull/2744/merge -> origin/pr/2744/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 884935cb98f0e29bd965fda9182970423d111d7e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 884935cb98f0e29bd965fda9182970423d111d7e
> git rev-list 42e3a6f8588046f257e5c780dec12d16d0314a66 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6704943479662226469.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3812416565813157439.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8451535733436451284.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6961187350016169677.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 19:27:59,818 f0b1d683 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/f0b1d683/pkb.log
2017-04-27 19:27:59,819 f0b1d683 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 19:27:59,820 f0b1d683 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 19:28:00,404 f0b1d683 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 19:28:00,616 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 19:28:00,620 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 19:28:00,620 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 19:28:00,627 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 19:28:00,631 f0b1d683 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 19:28:00,674 f0b1d683 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 19:28:00,675 f0b1d683 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/f0b1d683/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #340
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/340/display/redirect?page=changes>
Changes:
[dhalperi] [BEAM-59] Move IOChannelUtils.constructName to FileBasedSink
[lcwik] [BEAM-1871] Move several options/auth classes around in gcp-core
[altay] Add extra message to deprecated annotation
------------------------------------------
[...truncated 113.83 KB...]
building 'numpy.core.umath' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/umath -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/core/src/umath/ufunc_type_resolution.c
x86_64-linux-gnu-gcc: numpy/core/src/umath/ufunc_object.c
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/scalarmath.c
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/loops.c
x86_64-linux-gnu-gcc: numpy/core/src/umath/umathmodule.c
x86_64-linux-gnu-gcc: numpy/core/src/umath/reduction.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/core/src/umath/umathmodule.o build/temp.linux-x86_64-2.7/numpy/core/src/umath/reduction.o build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/loops.o build/temp.linux-x86_64-2.7/numpy/core/src/umath/ufunc_object.o build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/scalarmath.o build/temp.linux-x86_64-2.7/numpy/core/src/umath/ufunc_type_resolution.o -Lbuild/temp.linux-x86_64-2.7 -lnpymath -lm -o build/lib.linux-x86_64-2.7/numpy/core/umath.so
building 'numpy.core.umath_tests' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/umath_tests.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/umath_tests.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/umath_tests.so
building 'numpy.core.test_rational' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/test_rational.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/test_rational.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/test_rational.so
building 'numpy.core.struct_ufunc_test' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/struct_ufunc_test.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/struct_ufunc_test.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/struct_ufunc_test.so
building 'numpy.core.multiarray_tests' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/core/src/private/mem_overlap.c
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/multiarray/multiarray_tests.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/multiarray/multiarray_tests.o build/temp.linux-x86_64-2.7/numpy/core/src/private/mem_overlap.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/multiarray_tests.so
building 'numpy.core.operand_flag_tests' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-DHAVE_NPY_CONFIG_H=1 -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/core/src/umath/operand_flag_tests.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/core/src/umath/operand_flag_tests.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/core/operand_flag_tests.so
building 'numpy.fft.fftpack_lite' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/fft/fftpack.c
x86_64-linux-gnu-gcc: numpy/fft/fftpack_litemodule.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/fft/fftpack_litemodule.o build/temp.linux-x86_64-2.7/numpy/fft/fftpack.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/fft/fftpack_lite.so
building 'numpy.linalg.lapack_lite' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/python_xerbla.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlamch.c
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc4_’:
numpy/linalg/lapack_lite/dlamch.c:720:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc5_’:
numpy/linalg/lapack_lite/dlamch.c:834:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/blas_lite.c
numpy/linalg/lapack_lite/blas_lite.c: In function ‘cgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:352:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘dgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:6624:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘sgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:11190:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘zgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:15222:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: At top level:
numpy/linalg/lapack_lite/blas_lite.c:24:16: warning: ‘c__1’ defined but not used [-Wunused-variable]
static integer c__1 = 1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_litemodule.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlapack_lite.c
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘claed7_’:
numpy/linalg/lapack_lite/dlapack_lite.c:9857:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c:9857:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘dbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:27451:23: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static doublereal sminlo, tolmul;
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘sbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:64393:17: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static real sminlo, tolmul;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/f2c_lite.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/zlapack_lite.c
numpy/linalg/lapack_lite/zlapack_lite.c: In function ‘zlaed7_’:
numpy/linalg/lapack_lite/zlapack_lite.c:10000:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/zlapack_lite.c:10000:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/linalg/lapack_litemodule.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/python_xerbla.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/zlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/blas_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlamch.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/f2c_lite.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/linalg/lapack_lite.so
building 'numpy.linalg._umath_linalg' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/python_xerbla.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlamch.c
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc4_’:
numpy/linalg/lapack_lite/dlamch.c:720:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
numpy/linalg/lapack_lite/dlamch.c: In function ‘dlamc5_’:
numpy/linalg/lapack_lite/dlamch.c:834:13: warning: variable ‘i__1’ set but not used [-Wunused-but-set-variable]
integer i__1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/blas_lite.c
numpy/linalg/lapack_lite/blas_lite.c: In function ‘cgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:352:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘dgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:6624:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘sgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:11190:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: In function ‘zgemm_’:
numpy/linalg/lapack_lite/blas_lite.c:15222:20: warning: variable ‘ncola’ set but not used [-Wunused-but-set-variable]
static integer ncola;
^
numpy/linalg/lapack_lite/blas_lite.c: At top level:
numpy/linalg/lapack_lite/blas_lite.c:24:16: warning: ‘c__1’ defined but not used [-Wunused-variable]
static integer c__1 = 1;
^
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/dlapack_lite.c
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘claed7_’:
numpy/linalg/lapack_lite/dlapack_lite.c:9857:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c:9857:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘dbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:27451:23: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static doublereal sminlo, tolmul;
^
numpy/linalg/lapack_lite/dlapack_lite.c: In function ‘sbdsqr_’:
numpy/linalg/lapack_lite/dlapack_lite.c:64393:17: warning: variable ‘sminlo’ set but not used [-Wunused-but-set-variable]
static real sminlo, tolmul;
^
x86_64-linux-gnu-gcc: build/src.linux-x86_64-2.7/numpy/linalg/umath_linalg.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/f2c_lite.c
x86_64-linux-gnu-gcc: numpy/linalg/lapack_lite/zlapack_lite.c
numpy/linalg/lapack_lite/zlapack_lite.c: In function ‘zlaed7_’:
numpy/linalg/lapack_lite/zlapack_lite.c:10000:59: warning: variable ‘ind2’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
numpy/linalg/lapack_lite/zlapack_lite.c:10000:53: warning: variable ‘ind1’ set but not used [-Wunused-but-set-variable]
static integer i__, k, n1, n2, iq, iw, iz, ptr, ind1, ind2, indx, curr,
^
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/build/src.linux-x86_64-2.7/numpy/linalg/umath_linalg.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/python_xerbla.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/zlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlapack_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/blas_lite.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/dlamch.o build/temp.linux-x86_64-2.7/numpy/linalg/lapack_lite/f2c_lite.o -Lbuild/temp.linux-x86_64-2.7 -lnpymath -o build/lib.linux-x86_64-2.7/numpy/linalg/_umath_linalg.so
building 'numpy.random.mtrand' extension
compiling C sources
C compiler: x86_64-linux-gnu-gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC
compile options: '-D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D_LARGEFILE64_SOURCE=1 -Inumpy/core/include -Ibuild/src.linux-x86_64-2.7/numpy/core/include/numpy -Inumpy/core/src/private -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/usr/include/python2.7 -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -Ibuild/src.linux-x86_64-2.7/numpy/core/src/private -c'
x86_64-linux-gnu-gcc: numpy/random/mtrand/distributions.c
x86_64-linux-gnu-gcc: numpy/random/mtrand/mtrand.c
x86_64-linux-gnu-gcc: numpy/random/mtrand/initarray.c
x86_64-linux-gnu-gcc: numpy/random/mtrand/randomkit.c
x86_64-linux-gnu-gcc -pthread -shared -Wl,-O1 -Wl,-Bsymbolic-functions -Wl,-Bsymbolic-functions -Wl,-z,relro -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -D_FORTIFY_SOURCE=2 -g -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security build/temp.linux-x86_64-2.7/numpy/random/mtrand/mtrand.o build/temp.linux-x86_64-2.7/numpy/random/mtrand/randomkit.o build/temp.linux-x86_64-2.7/numpy/random/mtrand/initarray.o build/temp.linux-x86_64-2.7/numpy/random/mtrand/distributions.o -Lbuild/temp.linux-x86_64-2.7 -o build/lib.linux-x86_64-2.7/numpy/random/mtrand.so
Creating build/scripts.linux-x86_64-2.7/f2py
adding 'build/scripts.linux-x86_64-2.7/f2py' to scripts
changing mode of build/scripts.linux-x86_64-2.7/f2py from 644 to 755
warning: no previously-included files matching '*.pyo' found anywhere in distribution
warning: no previously-included files matching '*.pyd' found anywhere in distribution
changing mode of /home/jenkins/.local/bin/f2py to 755
Running setup.py install for functools32
warning: no files found matching '*.txt'
no previously-included directories found matching 'build'
no previously-included directories found matching 'dist'
no previously-included directories found matching '.git*'
Successfully installed python-gflags colorlog blinker futures PyYAML pint numpy functools32 contextlib2
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5195933728526926087.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 18:56:02,639 848488b6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/848488b6/pkb.log
2017-04-27 18:56:02,639 848488b6 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 18:56:02,639 848488b6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 18:56:03,032 848488b6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 18:56:03,124 848488b6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 18:56:03,127 848488b6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 18:56:03,127 848488b6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 18:56:03,133 848488b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 18:56:03,135 848488b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 18:56:03,159 848488b6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 18:56:03,160 848488b6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/848488b6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #339
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/339/display/redirect?page=changes>
Changes:
[wtanaka] Rename openWindows => windowsThatAreOpen
[chamikara] Adding validatesrunner test for sources
[lcwik] Update pom.xml
[lcwik] [BEAM-2060] Allow to specify charset in XmlIO
[lcwik] [BEAM-2060] Use withCharset(Charset) for the user facing API
[dhalperi] Remove unnecessary semicolons
[tgroh] Use Structural Value when comparing Window(AndTrigger) Namespaces
[altay] Add ValueProvider tests to json_value_test.py
[bchambers] [BEAM-1148] Port PAssert away from aggregators
[sisk] TextIO & AvroIO no longer validate schemas against IOChannelFactory
[altay] Increase post commit timeout from 600 seconds to 900
[robertwb] Add instructions to regenerate Python proto wrappers.
[robertwb] Generate python proto wrappers for runner and fn API.
[robertwb] Add apache licence to generated files.
[robertwb] Adapt to PR #2505 changes to protos.
[lcwik] [BEAM-1871] Move ProtoCoder to new sdks/java/extensions/protobuf
[tgroh] Properly Declare Protobuf extension dependencies
[tgroh] Stop Extending AtomicCoder
[altay] Pin apitools to 0.5.8
[iemejia] Fix error with the artifactId on Flink runner after refactor
[iemejia] [BEAM-2075] Update flink runner to use flink version 1.2.1
[aljoscha.krettek] [BEAM-1772] Support merging WindowFn other than IntervalWindow on Flink
[aljoscha.krettek] [BEAM-1812] Add externalized checkpoint configuration to
[dhalperi] ByteKey: remove ByteString from public API, replace with ByteBuffer
[lcwik] [BEAM-1877] Use Iterables.isEmpty in GroupIntoBatches
[tgroh] Add `Filter#equal`
[tgroh] Add HadoopResourceId
[tgroh] Add Cloud Object Translators for Coders
[tgroh] Revert "Add HadoopResourceId"
[altay] Fix in dataflow metrics
[bchambers] Removing Aggregators from Examples
[bchambers] Removing Aggregators from runner-specific examples and tests
[bchambers] Removing Aggregators from PipelineResults and subclasses
[sourabhbajaj] [BEAM-2068] Update to latest version of apitools
[lcwik] [BEAM-1871] Move Bigquery/Pubsub options to
[tgroh] Make Most StandardCoders CustomCoders
[chamikara] [BEAM-1988] Add FileSystems Interface for accessing underlying FS
[altay] [BEAM-1989] Fix the syntax warning from import star
[altay] [BEAM-1749] Upgrade to pycodestyle
[dhalperi] Datastore: fix use of deprecated function
[wtanaka] Remove unused private fields
[chamikara] Updates DoFn invocation logic to be more extensible.
[lcwik] [BEAM-1871] Move ByteStringCoder to sdks/java/extensions/protobuf
[dhalperi] Update maven surefire and failsafe plugins to version 2.20
[lcwik] [BEAM-1871] Move functionality from AvroUtils to AvroSource hiding
[dhalperi] Add surefire-plugin.version property to archetype pom.xml
[tgroh] Remove AtomicCoder
[aviemzur] [BEAM-1958] Standard IO Metrics in Java SDK
[tgroh] Fix small typo in comment in CoderRegistry
[lcwik] [BEAM-1871] Remove deprecated methods from AvroCoder
[lcwik] [BEAM-2060] Add charset support in XmlSink
[lcwik] [BEAM-1871] Move RetryHttpRequestInitializer and remove deprecated
[dhalperi] LocalResourceId: make toString end in '/' for directories
[dhalperi] FileSystems: make tolerant of and more efficient for empty lists
[dhalperi] LocalFileSystem: create parent directories if needed
[lcwik] Add getElementCoders to UnionCoder
[dhalperi] Make it possible to test runners that don't support all metrics
[lcwik] Make WindowedValueCoder an Interface
[lcwik] [BEAM-1871] Drop usage of Jackson/CloudObject from CoGbkResultSchema
[kirpichov] [BEAM-1573] Use Kafka serializers instead of coders in KafkaIO
[bchambers] Remove aggregators from Dataflow runner
[klk] Replace OutputTimeFn UDF with TimestampCombiner enum
[lcwik] [BEAM-1871] Clean-up org.apache.beam.sdk.util, move BitSetCoder from
[lcwik] [BEAM-1871] Re-add BitSetCoder to sdk/util for Dataflow worker.
[altay] Do not depend on message id in DataflowRunner
[altay] [BEAM-1316] start bundle should not output any elements
[robertwb] Per-transform runner api dispatch.
[robertwb] Translate flatten to Runner API.
[robertwb] Translate WindowInto through the Runner API.
[robertwb] Factor out URN registration logic.
[kirpichov] update JavaDoc for Count.globally
[tgroh] Add Registrars for Coder Cloud Object Translators
[dhalperi] FileBasedSink: fix typos
[klk] Revert "Replace OutputTimeFn UDF with TimestampCombiner enum"
[tgroh] Revert "Make WindowedValueCoder an Interface"
[iemejia] Use parent pom version of hadoop, move common deps into the hadoop
[iemejia] Change to commons-lang dependency to commons-lang3 to be consistent with
[jbonofre] [BEAM-2091] Typo in build instructions in Apex Runner's README.md
[klk] Do not rely on metrics in streaming TestDataflowRunner
[thw] BEAM-1766 Remove Aggregators from Apex runner
[lcwik] XmlIO and XmlSource now take an optional validationEventHandler to throw
[tgroh] Mark Pipeline#getPipelineOptions Experimental
------------------------------------------
Started by timer
Started by timer
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam6 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1babed250404d4c1b5ce82034e1cda0bcfa71c26 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1babed250404d4c1b5ce82034e1cda0bcfa71c26
> git rev-list a67019739dc7f09a8336b9606c3726ad5d546f51 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8481344159617934558.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5395040492010499161.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1482093818285122542.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7652032562621552715.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-27 17:24:40,325 c2085155 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c2085155/pkb.log
2017-04-27 17:24:40,325 c2085155 MainThread INFO PerfKitBenchmarker version: v1.11.0-45-g6f31bb3
2017-04-27 17:24:40,326 c2085155 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-27 17:24:40,901 c2085155 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-27 17:24:41,043 c2085155 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-27 17:24:41,045 c2085155 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-27 17:24:41,046 c2085155 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-27 17:24:41,051 c2085155 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-27 17:24:41,053 c2085155 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-27 17:24:41,108 c2085155 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-27 17:24:41,108 c2085155 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c2085155/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #338
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/338/display/redirect?page=changes>
Changes:
[altay] [BEAM-1988] Migrate from utils.path to BFS
------------------------------------------
[...truncated 270.92 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 0f11265...780e3cd refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! b448bef...16e9c65 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! a9fedd2...10b9545 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! afe991b...c82ff73 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 0ae3202...ec1b6e0 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2517/merge: No such file or directory
! fa0c57f...f442410 refs/pull/2517/merge -> origin/pr/2517/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2518/merge: No such file or directory
! 10a8893...54a9356 refs/pull/2518/merge -> origin/pr/2518/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2519/merge: No such file or directory
! 98ea9f6...aad7043 refs/pull/2519/merge -> origin/pr/2519/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2520/merge: No such file or directory
! fc04459...07f8717 refs/pull/2520/merge -> origin/pr/2520/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2522/merge: No such file or directory
! c99fa26...c740b2d refs/pull/2522/merge -> origin/pr/2522/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2525/merge: No such file or directory
! 441d1b2...7e01908 refs/pull/2525/merge -> origin/pr/2525/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2527/merge: No such file or directory
! 216da5f...feee33b refs/pull/2527/merge -> origin/pr/2527/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2528/merge: No such file or directory
! 01b3137...6ee7dcc refs/pull/2528/merge -> origin/pr/2528/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2531/merge: No such file or directory
! 49d5bde...e435821 refs/pull/2531/merge -> origin/pr/2531/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2534/merge: No such file or directory
! 081af1f...ef9e0fc refs/pull/2534/merge -> origin/pr/2534/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2535/merge: No such file or directory
! 7d4bdcb...4ad387e refs/pull/2535/merge -> origin/pr/2535/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2538/head: No such file or directory
! e1f3b03...142e469 refs/pull/2538/head -> origin/pr/2538/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2538/merge: No such file or directory
! 8c865f5...f824c27 refs/pull/2538/merge -> origin/pr/2538/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2541/merge: No such file or directory
! a7fdea3...8b9aa21 refs/pull/2541/merge -> origin/pr/2541/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2544/merge: No such file or directory
! e52973a...4c36b29 refs/pull/2544/merge -> origin/pr/2544/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2555/merge: No such file or directory
! 219db6f...04900c3 refs/pull/2555/merge -> origin/pr/2555/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2573/merge: No such file or directory
! ff7c24f...c92f372 refs/pull/2573/merge -> origin/pr/2573/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2578/merge: No such file or directory
! 9b3d521...2a90ded refs/pull/2578/merge -> origin/pr/2578/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2581/merge: No such file or directory
! b905438...b6f4753 refs/pull/2581/merge -> origin/pr/2581/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2591/merge: No such file or directory
! f0b2095...81d27bb refs/pull/2591/merge -> origin/pr/2591/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2593/merge: No such file or directory
! 88036dc...6950873 refs/pull/2593/merge -> origin/pr/2593/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2595/merge: No such file or directory
! a1da297...a86fe73 refs/pull/2595/merge -> origin/pr/2595/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2597/merge: No such file or directory
! f6d46f5...bad5fb6 refs/pull/2597/merge -> origin/pr/2597/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2603/merge: No such file or directory
! 956876b...811d0eb refs/pull/2603/merge -> origin/pr/2603/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2609/merge: No such file or directory
! c596646...e8440c5 refs/pull/2609/merge -> origin/pr/2609/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2611/merge: No such file or directory
! cb24c79...a2fc9c6 refs/pull/2611/merge -> origin/pr/2611/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2612/merge: No such file or directory
! 071e347...fde1693 refs/pull/2612/merge -> origin/pr/2612/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2615/merge: No such file or directory
! 66b12ee...90a071d refs/pull/2615/merge -> origin/pr/2615/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2617/merge: No such file or directory
! fcaa4c1...8aeff7f refs/pull/2617/merge -> origin/pr/2617/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2620/merge: No such file or directory
! 94305ad...325d694 refs/pull/2620/merge -> origin/pr/2620/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2622/merge: No such file or directory
! 88414bb...bd3c5d0 refs/pull/2622/merge -> origin/pr/2622/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2625/merge: No such file or directory
! f8009ae...d4b3686 refs/pull/2625/merge -> origin/pr/2625/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2626/merge: No such file or directory
! f253a9a...a6320e1 refs/pull/2626/merge -> origin/pr/2626/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2627/merge: No such file or directory
! c0125ba...9b3449b refs/pull/2627/merge -> origin/pr/2627/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2630/merge: No such file or directory
! 7cc8e95...ca206d9 refs/pull/2630/merge -> origin/pr/2630/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2631/merge: No such file or directory
! 0373f59...5ece9c8 refs/pull/2631/merge -> origin/pr/2631/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2632/merge: No such file or directory
! 8fb02b8...6f95956 refs/pull/2632/merge -> origin/pr/2632/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2633/merge: No such file or directory
! e0d3a93...bfb2227 refs/pull/2633/merge -> origin/pr/2633/merge (unable to update local ref)
* [new ref] refs/pull/2634/head -> origin/pr/2634/head
* [new ref] refs/pull/2634/merge -> origin/pr/2634/merge
* [new ref] refs/pull/2635/head -> origin/pr/2635/head
* [new ref] refs/pull/2636/head -> origin/pr/2636/head
* [new ref] refs/pull/2636/merge -> origin/pr/2636/merge
* [new ref] refs/pull/2637/head -> origin/pr/2637/head
* [new ref] refs/pull/2637/merge -> origin/pr/2637/merge
* [new ref] refs/pull/2638/head -> origin/pr/2638/head
* [new ref] refs/pull/2638/merge -> origin/pr/2638/merge
* [new ref] refs/pull/2639/head -> origin/pr/2639/head
* [new ref] refs/pull/2639/merge -> origin/pr/2639/merge
* [new ref] refs/pull/2640/head -> origin/pr/2640/head
* [new ref] refs/pull/2640/merge -> origin/pr/2640/merge
* [new ref] refs/pull/2641/head -> origin/pr/2641/head
* [new ref] refs/pull/2641/merge -> origin/pr/2641/merge
* [new ref] refs/pull/2642/head -> origin/pr/2642/head
* [new ref] refs/pull/2642/merge -> origin/pr/2642/merge
* [new ref] refs/pull/2643/head -> origin/pr/2643/head
* [new ref] refs/pull/2643/merge -> origin/pr/2643/merge
* [new ref] refs/pull/2644/head -> origin/pr/2644/head
* [new ref] refs/pull/2644/merge -> origin/pr/2644/merge
* [new ref] refs/pull/2645/head -> origin/pr/2645/head
* [new ref] refs/pull/2645/merge -> origin/pr/2645/merge
* [new ref] refs/pull/2646/head -> origin/pr/2646/head
* [new ref] refs/pull/2646/merge -> origin/pr/2646/merge
* [new ref] refs/pull/2647/head -> origin/pr/2647/head
* [new ref] refs/pull/2647/merge -> origin/pr/2647/merge
* [new ref] refs/pull/2648/head -> origin/pr/2648/head
* [new ref] refs/pull/2648/merge -> origin/pr/2648/merge
* [new ref] refs/pull/2649/head -> origin/pr/2649/head
* [new ref] refs/pull/2649/merge -> origin/pr/2649/merge
* [new ref] refs/pull/2650/head -> origin/pr/2650/head
* [new ref] refs/pull/2650/merge -> origin/pr/2650/merge
* [new ref] refs/pull/2651/head -> origin/pr/2651/head
* [new ref] refs/pull/2651/merge -> origin/pr/2651/merge
* [new ref] refs/pull/2652/head -> origin/pr/2652/head
* [new ref] refs/pull/2652/merge -> origin/pr/2652/merge
* [new ref] refs/pull/2653/head -> origin/pr/2653/head
* [new ref] refs/pull/2653/merge -> origin/pr/2653/merge
* [new ref] refs/pull/2654/head -> origin/pr/2654/head
* [new ref] refs/pull/2654/merge -> origin/pr/2654/merge
* [new ref] refs/pull/2655/head -> origin/pr/2655/head
* [new ref] refs/pull/2655/merge -> origin/pr/2655/merge
* [new ref] refs/pull/2656/head -> origin/pr/2656/head
* [new ref] refs/pull/2656/merge -> origin/pr/2656/merge
* [new ref] refs/pull/2657/head -> origin/pr/2657/head
* [new ref] refs/pull/2657/merge -> origin/pr/2657/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor584.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a67019739dc7f09a8336b9606c3726ad5d546f51 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a67019739dc7f09a8336b9606c3726ad5d546f51
> git rev-list 1dce98f0745e9c1cc4d83a7532895f2f28ec86bf # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3820256674966605868.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1772409161506125821.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7031598677226722041.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5096140202131393241.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-24 01:19:55,466 3daa2bb9 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3daa2bb9/pkb.log
2017-04-24 01:19:55,466 3daa2bb9 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-24 01:19:55,467 3daa2bb9 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-24 01:19:55,799 3daa2bb9 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-24 01:19:55,889 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-24 01:19:55,892 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-24 01:19:55,892 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-24 01:19:55,897 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-24 01:19:55,899 3daa2bb9 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-24 01:19:55,924 3daa2bb9 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-24 01:19:55,925 3daa2bb9 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3daa2bb9/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #337
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/337/display/redirect?page=changes>
Changes:
[lcwik] Validates that input and output GCS paths specify a bucket
[kirpichov] Makes cachedSplitResult transient in BigQuerySourceBase
[lcwik] Update Dataflow Worker Version
[tgroh] Coder.structuralValue(T) should never throw
[chamikara] [BEAM-1988] Add join operation to the filesystem
[chamikara] Change dataflow Job log from info to debug
[tgroh] Remove DeterministicStandardCoder
[lcwik] [BEAM-1786] Post Dataflow worker CoderRegistry clean-up
[lcwik] [BEAM-1871] Remove unnecessary runtime dependencies for Google Cloud
[lcwik] [BEAM-1871] Move Xml IO and related classes to new sdks/java/io/xml
[kirpichov] Introduces GenerateSequence transform
[kirpichov] Replaces all usages of CountingInput with GenerateSequence
[kirpichov] Deletes CountingInput
[kirpichov] Replaces fromTo() with from().to()
[tgroh] Make SimplePCollectionView Visible
[jbonofre] [BEAM-2044] Upgrade HBaseIO to use HBase client version 1.3.1
[kirpichov] [BEAM-1428] KinesisIO should comply with PTransform style guide
[jbonofre] [BEAM-2044] Downgrade HBaseIO to use the stable HBase client version
------------------------------------------
[...truncated 301.79 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2565/merge: No such file or directory
! 8d8deaa...0d15126 refs/pull/2565/merge -> origin/pr/2565/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2577/merge: No such file or directory
! c754797...318505c refs/pull/2577/merge -> origin/pr/2577/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2578/merge: No such file or directory
! 9626f20...9b3d521 refs/pull/2578/merge -> origin/pr/2578/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2579/merge: No such file or directory
! 612129b...23a6992 refs/pull/2579/merge -> origin/pr/2579/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2583/merge: No such file or directory
! 10f5731...0036268 refs/pull/2583/merge -> origin/pr/2583/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2585/merge: No such file or directory
! 9d76f1b...2e46ca2 refs/pull/2585/merge -> origin/pr/2585/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2586/merge: No such file or directory
! 96ed22a...01309ce refs/pull/2586/merge -> origin/pr/2586/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2587/merge: No such file or directory
! 5007331...afc4e4d refs/pull/2587/merge -> origin/pr/2587/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2591/head: No such file or directory
! 09693e1...dddf8ea refs/pull/2591/head -> origin/pr/2591/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2591/merge: No such file or directory
! 8e64258...f0b2095 refs/pull/2591/merge -> origin/pr/2591/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2592/merge: No such file or directory
! 4a576ac...745acd7 refs/pull/2592/merge -> origin/pr/2592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2593/merge: No such file or directory
! a155fdd...88036dc refs/pull/2593/merge -> origin/pr/2593/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2594/merge: No such file or directory
! f84f6e6...088b3f8 refs/pull/2594/merge -> origin/pr/2594/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2595/merge: No such file or directory
! 1f9dbb3...a1da297 refs/pull/2595/merge -> origin/pr/2595/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2596/merge: No such file or directory
! 1632f84...4711963 refs/pull/2596/merge -> origin/pr/2596/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2597/merge: No such file or directory
! 760bf36...f6d46f5 refs/pull/2597/merge -> origin/pr/2597/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2601/head: No such file or directory
! a79e43e..10545e5 refs/pull/2601/head -> origin/pr/2601/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2601/merge: No such file or directory
! be457d8...e614410 refs/pull/2601/merge -> origin/pr/2601/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2602/merge: No such file or directory
! c392c0a...9b63013 refs/pull/2602/merge -> origin/pr/2602/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2603/merge: No such file or directory
! c93f436...956876b refs/pull/2603/merge -> origin/pr/2603/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2604/merge: No such file or directory
! b6086fd...db1763c refs/pull/2604/merge -> origin/pr/2604/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2606/merge: No such file or directory
! 20d5c0c...d5bb314 refs/pull/2606/merge -> origin/pr/2606/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2607/merge: No such file or directory
! 9c1b65b...77bc015 refs/pull/2607/merge -> origin/pr/2607/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2608/merge: No such file or directory
! 4aac841...0a79e06 refs/pull/2608/merge -> origin/pr/2608/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2609/merge: No such file or directory
! 06c64e4...c596646 refs/pull/2609/merge -> origin/pr/2609/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2611/merge: No such file or directory
! d8747f5...cb24c79 refs/pull/2611/merge -> origin/pr/2611/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2612/head: No such file or directory
! 1fbab77...43c6c3a refs/pull/2612/head -> origin/pr/2612/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2612/merge: No such file or directory
! 063960f...071e347 refs/pull/2612/merge -> origin/pr/2612/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2615/merge: No such file or directory
! 905ac4d...66b12ee refs/pull/2615/merge -> origin/pr/2615/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2617/merge: No such file or directory
! 43412f1...fcaa4c1 refs/pull/2617/merge -> origin/pr/2617/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2620/merge: No such file or directory
! 8e44ad3...94305ad refs/pull/2620/merge -> origin/pr/2620/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2622/merge: No such file or directory
! bad5814...88414bb refs/pull/2622/merge -> origin/pr/2622/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2625/merge: No such file or directory
! 181104c...f8009ae refs/pull/2625/merge -> origin/pr/2625/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2626/head: No such file or directory
! 7365423...6d4aeab refs/pull/2626/head -> origin/pr/2626/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2626/merge: No such file or directory
! a20a922...f253a9a refs/pull/2626/merge -> origin/pr/2626/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2627/merge: No such file or directory
! 750ee4a...c0125ba refs/pull/2627/merge -> origin/pr/2627/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2629/merge: No such file or directory
! 96be125...94801ef refs/pull/2629/merge -> origin/pr/2629/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2630/merge: No such file or directory
! f558484...7cc8e95 refs/pull/2630/merge -> origin/pr/2630/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2631/merge: No such file or directory
! 54713d3...0373f59 refs/pull/2631/merge -> origin/pr/2631/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2632/head: No such file or directory
! f4f94db..c040104 refs/pull/2632/head -> origin/pr/2632/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2632/merge: No such file or directory
! 8bd47d1...8fb02b8 refs/pull/2632/merge -> origin/pr/2632/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2633/merge: No such file or directory
! c0af0a3...e0d3a93 refs/pull/2633/merge -> origin/pr/2633/merge (unable to update local ref)
* [new ref] refs/pull/2634/head -> origin/pr/2634/head
* [new ref] refs/pull/2634/merge -> origin/pr/2634/merge
* [new ref] refs/pull/2635/head -> origin/pr/2635/head
* [new ref] refs/pull/2636/head -> origin/pr/2636/head
* [new ref] refs/pull/2636/merge -> origin/pr/2636/merge
* [new ref] refs/pull/2637/head -> origin/pr/2637/head
* [new ref] refs/pull/2637/merge -> origin/pr/2637/merge
* [new ref] refs/pull/2638/head -> origin/pr/2638/head
* [new ref] refs/pull/2638/merge -> origin/pr/2638/merge
* [new ref] refs/pull/2639/head -> origin/pr/2639/head
* [new ref] refs/pull/2639/merge -> origin/pr/2639/merge
* [new ref] refs/pull/2640/head -> origin/pr/2640/head
* [new ref] refs/pull/2640/merge -> origin/pr/2640/merge
* [new ref] refs/pull/2641/head -> origin/pr/2641/head
* [new ref] refs/pull/2641/merge -> origin/pr/2641/merge
* [new ref] refs/pull/2642/head -> origin/pr/2642/head
* [new ref] refs/pull/2642/merge -> origin/pr/2642/merge
* [new ref] refs/pull/2643/head -> origin/pr/2643/head
* [new ref] refs/pull/2643/merge -> origin/pr/2643/merge
* [new ref] refs/pull/2644/head -> origin/pr/2644/head
* [new ref] refs/pull/2644/merge -> origin/pr/2644/merge
* [new ref] refs/pull/2645/head -> origin/pr/2645/head
* [new ref] refs/pull/2645/merge -> origin/pr/2645/merge
* [new ref] refs/pull/2646/head -> origin/pr/2646/head
* [new ref] refs/pull/2646/merge -> origin/pr/2646/merge
* [new ref] refs/pull/2647/head -> origin/pr/2647/head
* [new ref] refs/pull/2647/merge -> origin/pr/2647/merge
* [new ref] refs/pull/2648/head -> origin/pr/2648/head
* [new ref] refs/pull/2648/merge -> origin/pr/2648/merge
* [new ref] refs/pull/2649/head -> origin/pr/2649/head
* [new ref] refs/pull/2649/merge -> origin/pr/2649/merge
* [new ref] refs/pull/2650/head -> origin/pr/2650/head
* [new ref] refs/pull/2650/merge -> origin/pr/2650/merge
* [new ref] refs/pull/2651/head -> origin/pr/2651/head
* [new ref] refs/pull/2651/merge -> origin/pr/2651/merge
* [new ref] refs/pull/2652/head -> origin/pr/2652/head
* [new ref] refs/pull/2652/merge -> origin/pr/2652/merge
* [new ref] refs/pull/2653/head -> origin/pr/2653/head
* [new ref] refs/pull/2653/merge -> origin/pr/2653/merge
* [new ref] refs/pull/2654/head -> origin/pr/2654/head
* [new ref] refs/pull/2654/merge -> origin/pr/2654/merge
* [new ref] refs/pull/2655/head -> origin/pr/2655/head
* [new ref] refs/pull/2655/merge -> origin/pr/2655/merge
* [new ref] refs/pull/2656/head -> origin/pr/2656/head
* [new ref] refs/pull/2656/merge -> origin/pr/2656/merge
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! 33b68a2...f9612e3 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 88fbba8...0d9a8ae refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1dce98f0745e9c1cc4d83a7532895f2f28ec86bf (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1dce98f0745e9c1cc4d83a7532895f2f28ec86bf
> git rev-list f3806f64f2f80d9ff04f161bb60bbfe6c663dd05 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5115482460724809902.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3477231007021095089.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson64432856848543630.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3378241908788949308.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-23 13:17:35,444 d31400d9 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d31400d9/pkb.log
2017-04-23 13:17:35,444 d31400d9 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-23 13:17:35,445 d31400d9 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-23 13:17:35,977 d31400d9 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-23 13:17:36,096 d31400d9 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-23 13:17:36,098 d31400d9 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-23 13:17:36,099 d31400d9 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-23 13:17:36,105 d31400d9 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-23 13:17:36,108 d31400d9 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-23 13:17:36,118 d31400d9 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-23 13:17:36,119 d31400d9 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d31400d9/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #336
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/336/display/redirect?page=changes>
Changes:
[klk] Inline and remove POutputValueBase
[tgroh] Improve GlobalWindow, IntervalWindow Coders
------------------------------------------
[...truncated 232.45 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f3806f64f2f80d9ff04f161bb60bbfe6c663dd05 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f3806f64f2f80d9ff04f161bb60bbfe6c663dd05
> git rev-list 8160924e12a4723df34209a04c907d4f95466ecf # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8714472946511256926.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1848932547714709924.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2766001969086583293.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3630428433477182461.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 18:01:49,081 570bf0bd MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/570bf0bd/pkb.log
2017-04-21 18:01:49,081 570bf0bd MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 18:01:49,082 570bf0bd MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 18:01:49,420 570bf0bd MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 18:01:49,498 570bf0bd MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 18:01:49,500 570bf0bd MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 18:01:49,501 570bf0bd MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 18:01:49,504 570bf0bd MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 18:01:49,506 570bf0bd MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 18:01:49,536 570bf0bd MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 18:01:49,537 570bf0bd MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/570bf0bd/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #335
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/335/display/redirect?page=changes>
Changes:
[aljoscha.krettek] [BEAM-773] Implement Metrics support for Flink runner
[aljoscha.krettek] Add IO metrics to Flink runner
[aljoscha.krettek] Ensure all Read outputs are consumed in Flink runner
------------------------------------------
[...truncated 264.67 KB...]
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
* [new ref] refs/pull/2613/head -> origin/pr/2613/head
* [new ref] refs/pull/2614/head -> origin/pr/2614/head
* [new ref] refs/pull/2615/head -> origin/pr/2615/head
* [new ref] refs/pull/2615/merge -> origin/pr/2615/merge
* [new ref] refs/pull/2616/head -> origin/pr/2616/head
* [new ref] refs/pull/2616/merge -> origin/pr/2616/merge
* [new ref] refs/pull/2617/head -> origin/pr/2617/head
* [new ref] refs/pull/2617/merge -> origin/pr/2617/merge
* [new ref] refs/pull/2618/head -> origin/pr/2618/head
* [new ref] refs/pull/2619/head -> origin/pr/2619/head
* [new ref] refs/pull/2619/merge -> origin/pr/2619/merge
* [new ref] refs/pull/2620/head -> origin/pr/2620/head
* [new ref] refs/pull/2620/merge -> origin/pr/2620/merge
* [new ref] refs/pull/2621/head -> origin/pr/2621/head
* [new ref] refs/pull/2621/merge -> origin/pr/2621/merge
* [new ref] refs/pull/2622/head -> origin/pr/2622/head
* [new ref] refs/pull/2622/merge -> origin/pr/2622/merge
* [new ref] refs/pull/2623/head -> origin/pr/2623/head
* [new ref] refs/pull/2623/merge -> origin/pr/2623/merge
* [new ref] refs/pull/2624/head -> origin/pr/2624/head
* [new ref] refs/pull/2625/head -> origin/pr/2625/head
* [new ref] refs/pull/2625/merge -> origin/pr/2625/merge
* [new ref] refs/pull/2626/head -> origin/pr/2626/head
* [new ref] refs/pull/2626/merge -> origin/pr/2626/merge
* [new ref] refs/pull/2627/head -> origin/pr/2627/head
* [new ref] refs/pull/2627/merge -> origin/pr/2627/merge
* [new ref] refs/pull/2628/head -> origin/pr/2628/head
* [new ref] refs/pull/2628/merge -> origin/pr/2628/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 2ecab23...856bade refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8160924e12a4723df34209a04c907d4f95466ecf (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8160924e12a4723df34209a04c907d4f95466ecf
> git rev-list b3827955e3898b5f39d5b45db40c884b92cd3cef # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1736839190964272974.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4261684650816203298.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6450516308736435345.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4295639915615809346.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 12:02:40,509 fde62082 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/fde62082/pkb.log
2017-04-21 12:02:40,509 fde62082 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 12:02:40,510 fde62082 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 12:02:40,689 fde62082 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 12:02:40,784 fde62082 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 12:02:40,786 fde62082 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 12:02:40,786 fde62082 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 12:02:40,791 fde62082 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 12:02:40,793 fde62082 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 12:02:40,820 fde62082 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 12:02:40,821 fde62082 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/fde62082/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #334
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/334/display/redirect?page=changes>
Changes:
[klk] Make crashing errors in Structs unchecked exceptions
[klk] Derive Dataflow output names from steps, not PCollection names
[dhalperi] [BEAM-2012] Remove BoundedSource.splitIntoBundles for real
[dhalperi] Upgrade autovalue
[altay] Fix GCP import check in bigquery.py
------------------------------------------
[...truncated 272.29 KB...]
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
* [new ref] refs/pull/2613/head -> origin/pr/2613/head
* [new ref] refs/pull/2614/head -> origin/pr/2614/head
* [new ref] refs/pull/2615/head -> origin/pr/2615/head
* [new ref] refs/pull/2615/merge -> origin/pr/2615/merge
* [new ref] refs/pull/2616/head -> origin/pr/2616/head
* [new ref] refs/pull/2616/merge -> origin/pr/2616/merge
* [new ref] refs/pull/2617/head -> origin/pr/2617/head
* [new ref] refs/pull/2617/merge -> origin/pr/2617/merge
* [new ref] refs/pull/2618/head -> origin/pr/2618/head
* [new ref] refs/pull/2619/head -> origin/pr/2619/head
* [new ref] refs/pull/2619/merge -> origin/pr/2619/merge
* [new ref] refs/pull/2620/head -> origin/pr/2620/head
* [new ref] refs/pull/2620/merge -> origin/pr/2620/merge
* [new ref] refs/pull/2621/head -> origin/pr/2621/head
* [new ref] refs/pull/2621/merge -> origin/pr/2621/merge
* [new ref] refs/pull/2622/head -> origin/pr/2622/head
* [new ref] refs/pull/2622/merge -> origin/pr/2622/merge
* [new ref] refs/pull/2623/head -> origin/pr/2623/head
* [new ref] refs/pull/2623/merge -> origin/pr/2623/merge
* [new ref] refs/pull/2624/head -> origin/pr/2624/head
* [new ref] refs/pull/2625/head -> origin/pr/2625/head
* [new ref] refs/pull/2625/merge -> origin/pr/2625/merge
* [new ref] refs/pull/2626/head -> origin/pr/2626/head
* [new ref] refs/pull/2626/merge -> origin/pr/2626/merge
* [new ref] refs/pull/2627/head -> origin/pr/2627/head
* [new ref] refs/pull/2627/merge -> origin/pr/2627/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! c595f6e...2ecab23 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b3827955e3898b5f39d5b45db40c884b92cd3cef (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b3827955e3898b5f39d5b45db40c884b92cd3cef
> git rev-list 524165ac95d01e6c4e4b97911e5e4cce78677a93 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4192513743201487707.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2598521639352903674.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8704712167288035670.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6204150598789171428.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 06:02:09,245 bbfe7ede MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bbfe7ede/pkb.log
2017-04-21 06:02:09,245 bbfe7ede MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 06:02:09,245 bbfe7ede MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 06:02:09,595 bbfe7ede MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 06:02:09,674 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 06:02:09,676 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 06:02:09,676 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 06:02:09,680 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 06:02:09,682 bbfe7ede MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 06:02:09,712 bbfe7ede MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 06:02:09,712 bbfe7ede MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bbfe7ede/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #333
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/333/display/redirect?page=changes>
Changes:
[dhalperi] Add javadoc to the Metric interfaces
[dhalperi] Fix javadoc typo
[klk] Remove Sink in favor of FileBasedSink
[lcwik] [BEAM-1786, BEAM-1871] Add the ability to register coder factories for
[lcwik] [BEAM-1871] Move over GcsPath to gcp-core
[dhalperi] [BEAM-59] FileBasedSource: convert to FileSystem
[kirpichov] [BEAM-1992] Move Count.PerElement javadoc to a public place
[kirpichov] Fix erroneous use of .expand() in KafkaIO
[altay] Remove _unused_options_id
------------------------------------------
[...truncated 268.19 KB...]
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
* [new ref] refs/pull/2613/head -> origin/pr/2613/head
* [new ref] refs/pull/2614/head -> origin/pr/2614/head
* [new ref] refs/pull/2615/head -> origin/pr/2615/head
* [new ref] refs/pull/2615/merge -> origin/pr/2615/merge
* [new ref] refs/pull/2616/head -> origin/pr/2616/head
* [new ref] refs/pull/2616/merge -> origin/pr/2616/merge
* [new ref] refs/pull/2617/head -> origin/pr/2617/head
* [new ref] refs/pull/2617/merge -> origin/pr/2617/merge
* [new ref] refs/pull/2618/head -> origin/pr/2618/head
* [new ref] refs/pull/2618/merge -> origin/pr/2618/merge
* [new ref] refs/pull/2619/head -> origin/pr/2619/head
* [new ref] refs/pull/2619/merge -> origin/pr/2619/merge
* [new ref] refs/pull/2620/head -> origin/pr/2620/head
* [new ref] refs/pull/2620/merge -> origin/pr/2620/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 7088ca3...c595f6e refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 524165ac95d01e6c4e4b97911e5e4cce78677a93 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 524165ac95d01e6c4e4b97911e5e4cce78677a93
> git rev-list bf16b4a80562cb9db1cd4adba354dd393ed7afd0 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1838359322014054068.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1019098651526907023.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4757535067975429973.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8186375252874857784.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-21 00:02:23,450 17af334b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/17af334b/pkb.log
2017-04-21 00:02:23,450 17af334b MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-21 00:02:23,451 17af334b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-21 00:02:23,848 17af334b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-21 00:02:23,938 17af334b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-21 00:02:23,941 17af334b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-21 00:02:23,941 17af334b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-21 00:02:23,947 17af334b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-21 00:02:23,949 17af334b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-21 00:02:23,974 17af334b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-21 00:02:23,975 17af334b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/17af334b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #332
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/332/display/redirect?page=changes>
Changes:
[tgroh] [BEAM-1948] Defend against absent Aggregators
[robertwb] [BEAM-662] Fix for allowing floating point periods in windows
[robertwb] Make stage names consistent.
[robertwb] Require deterministic window coders.
[robertwb] Enable IntervalWindowCoder test check.
[robertwb] Remove obsolete and unused Runner.clear
[robertwb] Rename AfterFirst to AfterAny for consistency with Java.
[robertwb] Remove bigshuffle from python examples
[robertwb] Remove vestigial Read and Write from core.py
[aljoscha.krettek] [BEAM-1886] Remove TextIO override in Flink runner
[aljoscha.krettek] Exclude UsesSplittableParDoWithWindowedSideInputs in Flink Stream Runner
[altay] Fix KafkaIO javadoc typo
------------------------------------------
[...truncated 261.02 KB...]
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
* [new ref] refs/pull/2610/head -> origin/pr/2610/head
* [new ref] refs/pull/2610/merge -> origin/pr/2610/merge
* [new ref] refs/pull/2611/head -> origin/pr/2611/head
* [new ref] refs/pull/2611/merge -> origin/pr/2611/merge
* [new ref] refs/pull/2612/head -> origin/pr/2612/head
* [new ref] refs/pull/2612/merge -> origin/pr/2612/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! b9bfa5a...7088ca3 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision bf16b4a80562cb9db1cd4adba354dd393ed7afd0 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f bf16b4a80562cb9db1cd4adba354dd393ed7afd0
> git rev-list 104f9823563c4a2cd2ef9495e9a16b3a219dd49b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4510350363730592827.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8634217960513722945.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4714285922725186566.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1069675392217594109.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 18:02:03,583 9cf86a74 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/9cf86a74/pkb.log
2017-04-20 18:02:03,584 9cf86a74 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 18:02:03,584 9cf86a74 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 18:02:04,221 9cf86a74 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 18:02:04,356 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 18:02:04,358 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 18:02:04,359 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 18:02:04,363 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 18:02:04,365 9cf86a74 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 18:02:04,378 9cf86a74 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 18:02:04,379 9cf86a74 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/9cf86a74/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #331
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/331/display/redirect>
------------------------------------------
[...truncated 259.73 KB...]
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
* [new ref] refs/pull/2608/head -> origin/pr/2608/head
* [new ref] refs/pull/2608/merge -> origin/pr/2608/merge
* [new ref] refs/pull/2609/head -> origin/pr/2609/head
* [new ref] refs/pull/2609/merge -> origin/pr/2609/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 104f9823563c4a2cd2ef9495e9a16b3a219dd49b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 104f9823563c4a2cd2ef9495e9a16b3a219dd49b
> git rev-list 104f9823563c4a2cd2ef9495e9a16b3a219dd49b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1686600943140788379.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5687234350595086105.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8890289747034149854.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5629853312363568363.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 12:01:56,850 3ffb136c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3ffb136c/pkb.log
2017-04-20 12:01:56,850 3ffb136c MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 12:01:56,851 3ffb136c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 12:01:57,047 3ffb136c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 12:01:57,126 3ffb136c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 12:01:57,128 3ffb136c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 12:01:57,129 3ffb136c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 12:01:57,134 3ffb136c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 12:01:57,136 3ffb136c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 12:01:57,165 3ffb136c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 12:01:57,165 3ffb136c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3ffb136c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #330
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/330/display/redirect?page=changes>
Changes:
[chamikara] add temp dataset location for non-query BigQuerySource
------------------------------------------
[...truncated 259.98 KB...]
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
* [new ref] refs/pull/2604/head -> origin/pr/2604/head
* [new ref] refs/pull/2604/merge -> origin/pr/2604/merge
* [new ref] refs/pull/2605/head -> origin/pr/2605/head
* [new ref] refs/pull/2605/merge -> origin/pr/2605/merge
* [new ref] refs/pull/2606/head -> origin/pr/2606/head
* [new ref] refs/pull/2606/merge -> origin/pr/2606/merge
* [new ref] refs/pull/2607/head -> origin/pr/2607/head
* [new ref] refs/pull/2607/merge -> origin/pr/2607/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 0d420d3...b9bfa5a refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/959/merge: No such file or directory
! 39c9afa...25d5f19 refs/pull/959/merge -> origin/pr/959/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/984/merge: No such file or directory
! 54fa2a8...da83b57 refs/pull/984/merge -> origin/pr/984/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 104f9823563c4a2cd2ef9495e9a16b3a219dd49b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 104f9823563c4a2cd2ef9495e9a16b3a219dd49b
> git rev-list 3ef614c72d24f44a8cf463040a2bcf17b9445bc8 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8286626980164617294.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson498259845201682450.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1786429201611599997.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2156720948161282351.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 06:02:22,876 e08fd0e7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/e08fd0e7/pkb.log
2017-04-20 06:02:22,876 e08fd0e7 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 06:02:22,876 e08fd0e7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 06:02:23,250 e08fd0e7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 06:02:23,343 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 06:02:23,345 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 06:02:23,346 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 06:02:23,352 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 06:02:23,354 e08fd0e7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 06:02:23,377 e08fd0e7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 06:02:23,378 e08fd0e7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/e08fd0e7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #329
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/329/display/redirect?page=changes>
Changes:
[kirpichov] Cache result of BigQuerySourceBase.split
[dhalperi] [BEAM-2015] Remove shared profile in runners/pom.xml and fix Dataflow
[lcwik] [BEAM-2014] Upgrade to Google Auth 0.6.1
[lcwik] [BEAM-2013] Upgrade to Jackson 2.8.8
[dhalperi] [BEAM-2017] Fix NPE in DataflowRunner when there are no metrics
[lcwik] [BEAM-1871] Remove another depedendency by moving TestCredential
[lcwik] Modify types for input PCollections of Flatten transform to that of the
[altay] added module option, use more common zero test, show module name in log
------------------------------------------
[...truncated 266.21 KB...]
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
* [new ref] refs/pull/2589/head -> origin/pr/2589/head
* [new ref] refs/pull/2589/merge -> origin/pr/2589/merge
* [new ref] refs/pull/2590/head -> origin/pr/2590/head
* [new ref] refs/pull/2590/merge -> origin/pr/2590/merge
* [new ref] refs/pull/2591/head -> origin/pr/2591/head
* [new ref] refs/pull/2591/merge -> origin/pr/2591/merge
* [new ref] refs/pull/2592/head -> origin/pr/2592/head
* [new ref] refs/pull/2592/merge -> origin/pr/2592/merge
* [new ref] refs/pull/2593/head -> origin/pr/2593/head
* [new ref] refs/pull/2593/merge -> origin/pr/2593/merge
* [new ref] refs/pull/2594/head -> origin/pr/2594/head
* [new ref] refs/pull/2594/merge -> origin/pr/2594/merge
* [new ref] refs/pull/2595/head -> origin/pr/2595/head
* [new ref] refs/pull/2595/merge -> origin/pr/2595/merge
* [new ref] refs/pull/2596/head -> origin/pr/2596/head
* [new ref] refs/pull/2596/merge -> origin/pr/2596/merge
* [new ref] refs/pull/2597/head -> origin/pr/2597/head
* [new ref] refs/pull/2597/merge -> origin/pr/2597/merge
* [new ref] refs/pull/2598/head -> origin/pr/2598/head
* [new ref] refs/pull/2598/merge -> origin/pr/2598/merge
* [new ref] refs/pull/2599/head -> origin/pr/2599/head
* [new ref] refs/pull/2599/merge -> origin/pr/2599/merge
* [new ref] refs/pull/2600/head -> origin/pr/2600/head
* [new ref] refs/pull/2600/merge -> origin/pr/2600/merge
* [new ref] refs/pull/2601/head -> origin/pr/2601/head
* [new ref] refs/pull/2601/merge -> origin/pr/2601/merge
* [new ref] refs/pull/2602/head -> origin/pr/2602/head
* [new ref] refs/pull/2602/merge -> origin/pr/2602/merge
* [new ref] refs/pull/2603/head -> origin/pr/2603/head
* [new ref] refs/pull/2603/merge -> origin/pr/2603/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! e816697...0d420d3 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/809/merge: No such file or directory
! ac26af4...50ab53b refs/pull/809/merge -> origin/pr/809/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/810/merge: No such file or directory
! edfdeb5...7cab9bf refs/pull/810/merge -> origin/pr/810/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/819/merge: No such file or directory
! 94703ec...f95321a refs/pull/819/merge -> origin/pr/819/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/838/merge: No such file or directory
! 53a8fe0...3eb5563 refs/pull/838/merge -> origin/pr/838/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/871/merge: No such file or directory
! 61f4dd5...dcc5b0b refs/pull/871/merge -> origin/pr/871/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/886/merge: No such file or directory
! 01f16da...9fe583c refs/pull/886/merge -> origin/pr/886/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! c0c0a26...c340815 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/902/merge: No such file or directory
! 38d7315...824f162 refs/pull/902/merge -> origin/pr/902/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/914/merge: No such file or directory
! 3c4444a...b93dd41 refs/pull/914/merge -> origin/pr/914/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/917/merge: No such file or directory
! 7db5e68...b264c75 refs/pull/917/merge -> origin/pr/917/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3ef614c72d24f44a8cf463040a2bcf17b9445bc8 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3ef614c72d24f44a8cf463040a2bcf17b9445bc8
> git rev-list 29e054a8d7ffe6a061dbbe9a1885185b02f4e8ec # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2663058786604102121.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8290558974798900018.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4943685089095665165.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7646488805423744271.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-20 00:02:03,418 bf07c8ef MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bf07c8ef/pkb.log
2017-04-20 00:02:03,418 bf07c8ef MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-20 00:02:03,418 bf07c8ef MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-20 00:02:03,849 bf07c8ef MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-20 00:02:03,935 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-20 00:02:03,938 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-20 00:02:03,938 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-20 00:02:03,943 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-20 00:02:03,945 bf07c8ef MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-20 00:02:03,971 bf07c8ef MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-20 00:02:03,972 bf07c8ef MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bf07c8ef/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #328
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/328/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-1994] Remove Flink examples package
[chamikara] [BEAM-1441] Remove deprecated ChannelFactory
[tgroh] Ensure all Read outputs are consumed in Dataflow
------------------------------------------
[...truncated 239.71 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 29e054a8d7ffe6a061dbbe9a1885185b02f4e8ec (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 29e054a8d7ffe6a061dbbe9a1885185b02f4e8ec
> git rev-list 8a00f225454bcc742e5b38a499237bd5de455fb7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8365579214532950003.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1454548667904036598.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1369842140295342366.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5369403042547739192.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 18:03:52,596 80cdb2f8 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/80cdb2f8/pkb.log
2017-04-19 18:03:52,597 80cdb2f8 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 18:03:52,598 80cdb2f8 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 18:03:53,263 80cdb2f8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 18:03:53,439 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 18:03:53,441 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 18:03:53,442 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 18:03:53,449 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 18:03:53,452 80cdb2f8 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 18:03:53,462 80cdb2f8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 18:03:53,463 80cdb2f8 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/80cdb2f8/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #327
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/327/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-1914]Â XmlIO now complies with PTransform style guide
[iemejia] Pin default commons-compress version to beam-parent pom
------------------------------------------
[...truncated 259.49 KB...]
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 04ca87a...b839137 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2576/merge -> origin/pr/2576/merge
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2584/merge -> origin/pr/2584/merge
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
* [new ref] refs/pull/2588/head -> origin/pr/2588/head
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 3af926b...e816697 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/610/merge: No such file or directory
! 48d03d0...ff3ad90 refs/pull/610/merge -> origin/pr/610/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/618/merge: No such file or directory
! ff85f45...bef390f refs/pull/618/merge -> origin/pr/618/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/682/merge: No such file or directory
! 74ed1e8...5a4558b refs/pull/682/merge -> origin/pr/682/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/727/merge: No such file or directory
! d20a818...9dea77a refs/pull/727/merge -> origin/pr/727/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/728/merge: No such file or directory
! ad97d7e...6a2c66f refs/pull/728/merge -> origin/pr/728/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/732/merge: No such file or directory
! 9161b26...4e32f69 refs/pull/732/merge -> origin/pr/732/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/740/merge: No such file or directory
! 69ac523...5faa7e1 refs/pull/740/merge -> origin/pr/740/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8a00f225454bcc742e5b38a499237bd5de455fb7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8a00f225454bcc742e5b38a499237bd5de455fb7
> git rev-list 57929fb802d0cb6a6b6c3f14819d473dc2ace113 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson855294298243729482.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2762815817616975954.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3848627904993101890.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1824862734094644161.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 12:02:27,362 10f41cb0 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/10f41cb0/pkb.log
2017-04-19 12:02:27,362 10f41cb0 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 12:02:27,363 10f41cb0 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 12:02:27,689 10f41cb0 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 12:02:27,781 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 12:02:27,783 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 12:02:27,784 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 12:02:27,792 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 12:02:27,794 10f41cb0 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 12:02:27,840 10f41cb0 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 12:02:27,840 10f41cb0 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/10f41cb0/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #326
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/326/display/redirect?page=changes>
Changes:
[dhalperi] Delete deprecated AttemptAndTimeBoundedExponentialBackoff
[dhalperi] Remove deprecated method in IOChannelUtils
[dhalperi] Remove deprecated/unused code from Pipeline
[dhalperi] Delete AttemptBoundedExponentialBackoff
[dhalperi] Delete IntervalBoundedExponentialBackoff
[dhalperi] Delete AppEngineEnvironment
[dhalperi] Upgrade worker to not depend on deprecated now deleted code
[dhalperi] Changed snappy version to 1.1.4-M3
[kirpichov] Separates side input test and side output test
[kirpichov] ProcessFn remembers more info about its application context
[kirpichov] Minor cleanups in ParDoEvaluator
[kirpichov] Extracts interface from PushbackSideInputDoFnRunner
[kirpichov] Creates ProcessFnRunner and wires it through ParDoEvaluator
[kirpichov] Explodes windows before GBKIKWI
[kirpichov] Use tableRefFunction throughout BigQueryIO. Constant table writes use
[kirpichov] Add PrepareWrite transform.
[kirpichov] Refactor streaming write branch into separate reusable components.
[kirpichov] Refactor batch load job path, and add support for data-dependent tables.
[kirpichov] Refactor batch loads, and add support for windowed writes.
[kirpichov] Fix tests to properly fake out BigQueryService, and add tests for
[kirpichov] Separate streaming writes into two pluggable components - CreateTables,
------------------------------------------
[...truncated 273.30 KB...]
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 3490028...04ca87a refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2576/merge -> origin/pr/2576/merge
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
* [new ref] refs/pull/2580/head -> origin/pr/2580/head
* [new ref] refs/pull/2581/head -> origin/pr/2581/head
* [new ref] refs/pull/2581/merge -> origin/pr/2581/merge
* [new ref] refs/pull/2582/head -> origin/pr/2582/head
* [new ref] refs/pull/2582/merge -> origin/pr/2582/merge
* [new ref] refs/pull/2583/head -> origin/pr/2583/head
* [new ref] refs/pull/2583/merge -> origin/pr/2583/merge
* [new ref] refs/pull/2584/head -> origin/pr/2584/head
* [new ref] refs/pull/2584/merge -> origin/pr/2584/merge
* [new ref] refs/pull/2585/head -> origin/pr/2585/head
* [new ref] refs/pull/2585/merge -> origin/pr/2585/merge
* [new ref] refs/pull/2586/head -> origin/pr/2586/head
* [new ref] refs/pull/2586/merge -> origin/pr/2586/merge
* [new ref] refs/pull/2587/head -> origin/pr/2587/head
* [new ref] refs/pull/2587/merge -> origin/pr/2587/merge
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! 19675f4...33b68a2 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/311/merge: No such file or directory
! b1b5420...38f43c8 refs/pull/311/merge -> origin/pr/311/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/314/merge: No such file or directory
! 049852e...387f0d0 refs/pull/314/merge -> origin/pr/314/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/373/merge: No such file or directory
! b76a439...e477b34 refs/pull/373/merge -> origin/pr/373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/405/merge: No such file or directory
! 49c7afb...53cc1f3 refs/pull/405/merge -> origin/pr/405/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/439/merge: No such file or directory
! 7316fec...1af3a6a refs/pull/439/merge -> origin/pr/439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/455/merge: No such file or directory
! 895dfbd...0cb45d9 refs/pull/455/merge -> origin/pr/455/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/456/merge: No such file or directory
! afdd93d...9f247c6 refs/pull/456/merge -> origin/pr/456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/477/merge: No such file or directory
! 0072b18...e6a7374 refs/pull/477/merge -> origin/pr/477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/478/merge: No such file or directory
! e6d165e...99723f9 refs/pull/478/merge -> origin/pr/478/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/501/merge: No such file or directory
! 774a826...1465309 refs/pull/501/merge -> origin/pr/501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/506/merge: No such file or directory
! b8b554c...10d253a refs/pull/506/merge -> origin/pr/506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/511/merge: No such file or directory
! 4e29989...7d39fcd refs/pull/511/merge -> origin/pr/511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/515/merge: No such file or directory
! 330a4ce...dd58944 refs/pull/515/merge -> origin/pr/515/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/541/merge: No such file or directory
! 359ac26...600cfee refs/pull/541/merge -> origin/pr/541/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/572/merge: No such file or directory
! 026ae3c...dfe226f refs/pull/572/merge -> origin/pr/572/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/577/merge: No such file or directory
! ebba24a...649c63b refs/pull/577/merge -> origin/pr/577/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/583/merge: No such file or directory
! 3ba48ca...1525173 refs/pull/583/merge -> origin/pr/583/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/586/merge: No such file or directory
! 4657dbe...52f541b refs/pull/586/merge -> origin/pr/586/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! f5b7f08...3af926b refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 57929fb802d0cb6a6b6c3f14819d473dc2ace113 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 57929fb802d0cb6a6b6c3f14819d473dc2ace113
> git rev-list 6d3fe51ce3240cea54e01cb61723f1547039904d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4777849911207284166.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1618973676818635769.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2986352072992804019.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3477464880998356108.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 06:02:25,873 027dd7cc MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/027dd7cc/pkb.log
2017-04-19 06:02:25,874 027dd7cc MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 06:02:25,875 027dd7cc MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 06:02:26,538 027dd7cc MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 06:02:26,700 027dd7cc MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 06:02:26,814 027dd7cc MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 06:02:26,815 027dd7cc MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 06:02:26,821 027dd7cc MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 06:02:26,823 027dd7cc MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 06:02:26,836 027dd7cc MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 06:02:26,837 027dd7cc MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/027dd7cc/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #325
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/325/display/redirect?page=changes>
Changes:
[kirpichov] Revert "Removes final minor usages of OldDoFn outside OldDoFn itself"
[dhalperi] [BEAM-1272] Align the naming of "generateInitialSplits" and
[kirpichov] [BEAM-1990] Comment: Don't use Window.Assign
[tgroh] Rename SideOutputValue to OutputValue
[dhalperi] runners-core-construction-java fix artifact name
[kirpichov] Gets rid of TFRecordIO.Read.Bound
[kirpichov] Converts TFRecordIO.Read to AutoValue
[kirpichov] Gets rid of TFRecordIO.Write.Bound
[kirpichov] Converts TFRecordIO.Write to AutoValue
[kirpichov] Removes unused validation parameter
[altay] Revert "Revert "Revert "Revert "Add ValueProvider class for
[altay] Revert "Revert "Throw specialized exception in value providers""
[altay] Remove options_id concept from templated runs.
[altay] [BEAM-1964] Upgrade Pylint
[lcwik] [BEAM-1871] Create new GCP core module package and move several GCP
------------------------------------------
[...truncated 217.71 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6d3fe51ce3240cea54e01cb61723f1547039904d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6d3fe51ce3240cea54e01cb61723f1547039904d
> git rev-list 8f4bb0158cecb8c4144766706fa9d70b094fc88d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1329739036196276955.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5801673408767828225.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5168717403391126895.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2981690994877704682.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-19 00:03:17,038 b91b9bc2 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b91b9bc2/pkb.log
2017-04-19 00:03:17,038 b91b9bc2 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-19 00:03:17,039 b91b9bc2 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-19 00:03:17,628 b91b9bc2 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-19 00:03:17,740 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-19 00:03:17,744 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-19 00:03:17,744 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-19 00:03:17,751 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-19 00:03:17,754 b91b9bc2 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-19 00:03:17,765 b91b9bc2 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-19 00:03:17,766 b91b9bc2 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b91b9bc2/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #324
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/324/display/redirect?page=changes>
Changes:
[iemejia] Enable flink dependency enforcement and make dependencies explicit
[iemejia] Fix Javadoc warnings on Flink Runner
[iemejia] Remove flink-annotations dependency
[iemejia] [BEAM-1993] Remove special unbounded Flink source/sink
[tgroh] Translate PTransforms to and from Runner API Protos
[altay] Clean up DirectRunner Clock and TransformResult
[altay] Remove overloading of __call__ in DirectRunner
[altay] Making metrics usage in datastore_wordcount consistent
[dhalperi] Fix Hadoop pom.xml
------------------------------------------
[...truncated 261.99 KB...]
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/head: No such file or directory
! 89d82a1..8c5778e refs/pull/2549/head -> origin/pr/2549/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 8278987...3490028 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2568/merge -> origin/pr/2568/merge
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
* [new ref] refs/pull/2573/head -> origin/pr/2573/head
* [new ref] refs/pull/2573/merge -> origin/pr/2573/merge
* [new ref] refs/pull/2574/head -> origin/pr/2574/head
* [new ref] refs/pull/2575/head -> origin/pr/2575/head
* [new ref] refs/pull/2575/merge -> origin/pr/2575/merge
* [new ref] refs/pull/2576/head -> origin/pr/2576/head
* [new ref] refs/pull/2576/merge -> origin/pr/2576/merge
* [new ref] refs/pull/2577/head -> origin/pr/2577/head
* [new ref] refs/pull/2577/merge -> origin/pr/2577/merge
* [new ref] refs/pull/2578/head -> origin/pr/2578/head
* [new ref] refs/pull/2578/merge -> origin/pr/2578/merge
* [new ref] refs/pull/2579/head -> origin/pr/2579/head
* [new ref] refs/pull/2579/merge -> origin/pr/2579/merge
error: unable to resolve reference refs/remotes/origin/pr/278/merge: No such file or directory
! 4c5e015...0d23148 refs/pull/278/merge -> origin/pr/278/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/284/merge: No such file or directory
! 5d30780...da52238 refs/pull/284/merge -> origin/pr/284/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 79eade4...f5b7f08 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8f4bb0158cecb8c4144766706fa9d70b094fc88d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8f4bb0158cecb8c4144766706fa9d70b094fc88d
> git rev-list e5568589cab11399126f678ad3fbca4b1fb715e4 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8901619799384700904.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6553407579883199676.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2767305992257758221.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1924418183473579911.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 18:02:36,580 64a3ea9e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/64a3ea9e/pkb.log
2017-04-18 18:02:36,586 64a3ea9e MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 18:02:36,587 64a3ea9e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 18:02:37,016 64a3ea9e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 18:02:37,133 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 18:02:37,135 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 18:02:37,135 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 18:02:37,140 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 18:02:37,142 64a3ea9e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 18:02:37,166 64a3ea9e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 18:02:37,166 64a3ea9e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/64a3ea9e/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #323
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/323/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-59] Register standard FileSystems wherever we register
------------------------------------------
[...truncated 258.28 KB...]
! d965a1a...43d8ac2 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! ee99a31...397b97d refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! bef69b5...2eef1fd refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 366bf52...8456a6d refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! c7c0bed...a3b43b6 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 431c487...214205d refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 1202743...5882b32 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 5650c43...8278987 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2568/merge -> origin/pr/2568/merge
* [new ref] refs/pull/2569/head -> origin/pr/2569/head
* [new ref] refs/pull/2569/merge -> origin/pr/2569/merge
* [new ref] refs/pull/2570/head -> origin/pr/2570/head
* [new ref] refs/pull/2570/merge -> origin/pr/2570/merge
* [new ref] refs/pull/2571/head -> origin/pr/2571/head
* [new ref] refs/pull/2571/merge -> origin/pr/2571/merge
* [new ref] refs/pull/2572/head -> origin/pr/2572/head
* [new ref] refs/pull/2572/merge -> origin/pr/2572/merge
error: unable to resolve reference refs/remotes/origin/pr/50/merge: No such file or directory
! 6f23618...9372791 refs/pull/50/merge -> origin/pr/50/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 6431456...79eade4 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/74/merge: No such file or directory
! b91b760...4562339 refs/pull/74/merge -> origin/pr/74/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/75/merge: No such file or directory
! e7cccaa...5331059 refs/pull/75/merge -> origin/pr/75/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e5568589cab11399126f678ad3fbca4b1fb715e4 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e5568589cab11399126f678ad3fbca4b1fb715e4
> git rev-list c52ce7c4bd952d943bccb8acff53b36b40c35428 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson39426978036214425.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5796789730107017061.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8375130796706901326.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6295393925086791677.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 12:02:18,566 d1d4b765 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d1d4b765/pkb.log
2017-04-18 12:02:18,566 d1d4b765 MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 12:02:18,566 d1d4b765 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 12:02:18,882 d1d4b765 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 12:02:18,962 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 12:02:18,964 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 12:02:18,964 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 12:02:18,969 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 12:02:18,970 d1d4b765 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 12:02:19,001 d1d4b765 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 12:02:19,001 d1d4b765 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d1d4b765/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #322
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/322/display/redirect?page=changes>
Changes:
[dhalperi] Only compile HIFIO ITs when compiling with java 8.
[tgroh] Set the Project of a Table Reference at Runtime
[altay] clean up description for sdk_location
[dhalperi] [BEAM-1991] Sum.SumDoubleFn => Sum.ofDoubles
------------------------------------------
[...truncated 263.13 KB...]
! 1c56862...d62e965 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 768927c...34bb7be refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! cb3f078...68b5b7a refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! a5be5fb...4e96823 refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! e135c9d...302aad6 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 652890a...649e96c refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! ae069b8...3ed695f refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 33fc584...366bf52 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! fc37405...c7c0bed refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! a700cb0...431c487 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 7b2c6ca...1202743 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! ead989f...38a153f refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 70aebaf...db83b85 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 9aec98c...8f11c5b refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 7be646c...5650c43 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
* [new ref] refs/pull/2558/head -> origin/pr/2558/head
* [new ref] refs/pull/2558/merge -> origin/pr/2558/merge
* [new ref] refs/pull/2559/head -> origin/pr/2559/head
* [new ref] refs/pull/2559/merge -> origin/pr/2559/merge
* [new ref] refs/pull/2560/head -> origin/pr/2560/head
* [new ref] refs/pull/2560/merge -> origin/pr/2560/merge
* [new ref] refs/pull/2561/head -> origin/pr/2561/head
* [new ref] refs/pull/2561/merge -> origin/pr/2561/merge
* [new ref] refs/pull/2562/head -> origin/pr/2562/head
* [new ref] refs/pull/2562/merge -> origin/pr/2562/merge
* [new ref] refs/pull/2563/head -> origin/pr/2563/head
* [new ref] refs/pull/2563/merge -> origin/pr/2563/merge
* [new ref] refs/pull/2564/head -> origin/pr/2564/head
* [new ref] refs/pull/2564/merge -> origin/pr/2564/merge
* [new ref] refs/pull/2565/head -> origin/pr/2565/head
* [new ref] refs/pull/2565/merge -> origin/pr/2565/merge
* [new ref] refs/pull/2566/head -> origin/pr/2566/head
* [new ref] refs/pull/2566/merge -> origin/pr/2566/merge
* [new ref] refs/pull/2567/head -> origin/pr/2567/head
* [new ref] refs/pull/2567/merge -> origin/pr/2567/merge
* [new ref] refs/pull/2568/head -> origin/pr/2568/head
* [new ref] refs/pull/2568/merge -> origin/pr/2568/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 1c5a0e0...6431456 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c52ce7c4bd952d943bccb8acff53b36b40c35428 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c52ce7c4bd952d943bccb8acff53b36b40c35428
> git rev-list 4ff244d49c678f658f437600559cbe0a99048f81 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7242308831951486378.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7246019932213222086.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3384791478864205582.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9142746497036719553.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 06:01:59,996 957bfc7b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/957bfc7b/pkb.log
2017-04-18 06:01:59,996 957bfc7b MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 06:01:59,997 957bfc7b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 06:02:00,103 957bfc7b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 06:02:00,187 957bfc7b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 06:02:00,190 957bfc7b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 06:02:00,190 957bfc7b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 06:02:00,197 957bfc7b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 06:02:00,199 957bfc7b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 06:02:00,221 957bfc7b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 06:02:00,221 957bfc7b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/957bfc7b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #321
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/321/display/redirect?page=changes>
Changes:
[tgroh] Remove reference to the isStreaming flag
[tgroh] Remove getSideInputWindow
[altay] Add no-else return to pylintrc
[chamikara] Update assertions of source_test_utils from camelcase to
------------------------------------------
[...truncated 255.61 KB...]
! 6777f68...e7b72b0 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2316/merge: No such file or directory
! fc0d1a7...9d9cbc5 refs/pull/2316/merge -> origin/pr/2316/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2330/merge: No such file or directory
! 03a7191...dc28d6a refs/pull/2330/merge -> origin/pr/2330/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 63c0b96...4be264d refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/head: No such file or directory
! a95e0a3..bfd7c69 refs/pull/2339/head -> origin/pr/2339/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 4d9e094...ea7f091 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! e458904...ad8ef4a refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! f74af87...4370eb0 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 49d6432...09fbed7 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/head: No such file or directory
! 3e3b510..09923b3 refs/pull/2417/head -> origin/pr/2417/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 4cc17f8...687a6f6 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! e3c990d...451130b refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! a4dbb92...2634824 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! e2506ce...3c9ed06 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! ceeb9d5...ffc6bdf refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 13f53f2...fa45070 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! a993257...b7a2dd1 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! 9f62c44...76cd8aa refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 1e0fb0f...33fc584 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! e65f319...fc37405 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! accb33b...a700cb0 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! e55db78...7b2c6ca refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! b94d459...ead989f refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 6f90c52...70aebaf refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 1760aeb...9aec98c refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! ad1a102...7be646c refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
* [new ref] refs/pull/2552/head -> origin/pr/2552/head
* [new ref] refs/pull/2552/merge -> origin/pr/2552/merge
* [new ref] refs/pull/2553/head -> origin/pr/2553/head
* [new ref] refs/pull/2553/merge -> origin/pr/2553/merge
* [new ref] refs/pull/2554/head -> origin/pr/2554/head
* [new ref] refs/pull/2554/merge -> origin/pr/2554/merge
* [new ref] refs/pull/2555/head -> origin/pr/2555/head
* [new ref] refs/pull/2555/merge -> origin/pr/2555/merge
* [new ref] refs/pull/2556/head -> origin/pr/2556/head
* [new ref] refs/pull/2556/merge -> origin/pr/2556/merge
* [new ref] refs/pull/2557/head -> origin/pr/2557/head
* [new ref] refs/pull/2557/merge -> origin/pr/2557/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 3607de7...1c5a0e0 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4ff244d49c678f658f437600559cbe0a99048f81 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4ff244d49c678f658f437600559cbe0a99048f81
> git rev-list 8302783c3239ddcf8b5259b4aff8ee33673d02cd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4475637422229182291.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5889208407194751846.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7039340731844299852.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1137852464107757677.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-18 00:02:07,135 30a3becb MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/30a3becb/pkb.log
2017-04-18 00:02:07,136 30a3becb MainThread INFO PerfKitBenchmarker version: v1.11.0-43-g6012a89
2017-04-18 00:02:07,136 30a3becb MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-18 00:02:07,273 30a3becb MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-18 00:02:07,358 30a3becb MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-18 00:02:07,361 30a3becb MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-18 00:02:07,361 30a3becb MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-18 00:02:07,367 30a3becb MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-18 00:02:07,370 30a3becb MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-18 00:02:07,398 30a3becb MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-18 00:02:07,398 30a3becb MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/30a3becb/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #320
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/320/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-1922] Close datasource in JdbcIO when possible
[tgroh] Update Dataflow Worker Version
[kirpichov] Javadoc fixups after style guide changes
------------------------------------------
[...truncated 258.35 KB...]
! c284b62...4ea7285 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! fc7e7c8...351df3a refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 22c3670...8923027 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 0fdba7c...c05b468 refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/head: No such file or directory
! 83bad83..3e3b510 refs/pull/2417/head -> origin/pr/2417/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 5eed698...4cc17f8 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2418/merge: No such file or directory
! 736dcc8...26d171e refs/pull/2418/merge -> origin/pr/2418/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 87cf1fe...e3c990d refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! cccd360...a4dbb92 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! bc3fb2f...3e6a75f refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 498d04f...6c488c2 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! ebb426d...76a6c17 refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! cd94a1d...ccb7a55 refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! dc8b790...45f2cae refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 722ca8e...e2506ce refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! b78575c...23b0870 refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 9dca2eb...5ff71d3 refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 3b8ec12...2094a82 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 1843110...ceeb9d5 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! eba7225...13f53f2 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! a8f1836...a993257 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 7534645...b1e3c5a refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 6b2b994...df85b9f refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! e0953a7...e5ccd7c refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! a6753b1...9f62c44 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! a11307a...1c56862 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! c7b289b...e135c9d refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 29cae96...652890a refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 1391cd4...1e0fb0f refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 0baa476...e65f319 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 0f3f9d2...accb33b refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! 4f2eee1...ad1a102 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
* [new ref] refs/pull/2551/head -> origin/pr/2551/head
* [new ref] refs/pull/2551/merge -> origin/pr/2551/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! dd8a5f2...3607de7 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8302783c3239ddcf8b5259b4aff8ee33673d02cd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8302783c3239ddcf8b5259b4aff8ee33673d02cd
> git rev-list 946778c5bb114814d1ba5ebe71a27bc960f9e59b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4430182060932767693.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1234025568128931991.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8578646212994847135.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4904381690154377724.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 18:01:50,094 7f2ef3cf MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/7f2ef3cf/pkb.log
2017-04-17 18:01:50,094 7f2ef3cf MainThread INFO PerfKitBenchmarker version: v1.11.0-42-g4158261
2017-04-17 18:01:50,095 7f2ef3cf MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 18:01:50,430 7f2ef3cf MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 18:01:50,509 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 18:01:50,511 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 18:01:50,511 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 18:01:50,516 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 18:01:50,518 7f2ef3cf MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 18:01:50,548 7f2ef3cf MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 18:01:50,548 7f2ef3cf MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/7f2ef3cf/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #319
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/319/display/redirect?page=changes>
Changes:
[jbonofre] Add javadoc to getCheckpointMark in UnboundedSource
[jbonofre] Fix javadoc warnings
------------------------------------------
[...truncated 255.50 KB...]
! 502da88...9363e9c refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! b0a00bd...e461807 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! bec8d58...26007e0 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! eefcb75...1207e61 refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! c53a4a4...e8b15dd refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! acb155f...422e309 refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 1e28b4d...a8882d5 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 7f686a9...5ad8a93 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2330/merge: No such file or directory
! 6a9103e...40050d1 refs/pull/2330/merge -> origin/pr/2330/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 890d1ed...0c05446 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 36cb659...670a00b refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! b0927d5...3e33bf1 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 8524d7b...5131c76 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 457cc80...e11f424 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 0ec058e...8b35a5d refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 557cdc4...5eed698 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 92f1d8c...87cf1fe refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! ae4da02...cccd360 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! f597223...722ca8e refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! d158c14...1843110 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 1eb04db...eba7225 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! c20273c...a8f1836 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! b1b8c98...7534645 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! 10bd14d...a6753b1 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! d8b33d0...ae069b8 refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 9cc3ca0...1391cd4 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 0f89790...0baa476 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! aed3bb9...0f3f9d2 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 9cc4e4d...e55db78 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! d646411...b94d459 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 1fdb7fe...6f90c52 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 4967edf...1760aeb refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
error: unable to resolve reference refs/remotes/origin/pr/2549/merge: No such file or directory
! eac251b...4f2eee1 refs/pull/2549/merge -> origin/pr/2549/merge (unable to update local ref)
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 60d65b7...dd8a5f2 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 946778c5bb114814d1ba5ebe71a27bc960f9e59b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 946778c5bb114814d1ba5ebe71a27bc960f9e59b
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2183302179321813950.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3671284807063179629.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5450963157070791769.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4835424911024664160.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 12:01:55,812 551eb6c1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/551eb6c1/pkb.log
2017-04-17 12:01:55,813 551eb6c1 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-17 12:01:55,813 551eb6c1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 12:01:56,289 551eb6c1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 12:01:56,369 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 12:01:56,371 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 12:01:56,372 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 12:01:56,376 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 12:01:56,378 551eb6c1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 12:01:56,407 551eb6c1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 12:01:56,408 551eb6c1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/551eb6c1/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #318
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/318/display/redirect>
------------------------------------------
[...truncated 237.35 KB...]
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 2358, done.
remote: Compressing objects: 0% (1/221) remote: Compressing objects: 1% (3/221) remote: Compressing objects: 2% (5/221) remote: Compressing objects: 3% (7/221) remote: Compressing objects: 4% (9/221) remote: Compressing objects: 5% (12/221) remote: Compressing objects: 6% (14/221) remote: Compressing objects: 7% (16/221) remote: Compressing objects: 8% (18/221) remote: Compressing objects: 9% (20/221) remote: Compressing objects: 10% (23/221) remote: Compressing objects: 11% (25/221) remote: Compressing objects: 12% (27/221) remote: Compressing objects: 13% (29/221) remote: Compressing objects: 14% (31/221) remote: Compressing objects: 15% (34/221) remote: Compressing objects: 16% (36/221) remote: Compressing objects: 17% (38/221) remote: Compressing objects: 18% (40/221) remote: Compressing objects: 19% (42/221) remote: Compressing objects: 20% (45/221) remote: Compressing objects: 21% (47/221) remote: Compressing objects: 22% (49/221) remote: Compressing objects: 23% (51/221) remote: Compressing objects: 24% (54/221) remote: Compressing objects: 25% (56/221) remote: Compressing objects: 26% (58/221) remote: Compressing objects: 27% (60/221) remote: Compressing objects: 28% (62/221) remote: Compressing objects: 29% (65/221) remote: Compressing objects: 30% (67/221) remote: Compressing objects: 31% (69/221) remote: Compressing objects: 32% (71/221) remote: Compressing objects: 33% (73/221) remote: Compressing objects: 34% (76/221) remote: Compressing objects: 35% (78/221) remote: Compressing objects: 36% (80/221) remote: Compressing objects: 37% (82/221) remote: Compressing objects: 38% (84/221) remote: Compressing objects: 39% (87/221) remote: Compressing objects: 40% (89/221) remote: Compressing objects: 41% (91/221) remote: Compressing objects: 42% (93/221) remote: Compressing objects: 43% (96/221) remote: Compressing objects: 44% (98/221) remote: Compressing objects: 45% (100/221) remote: Compressing objects: 46% (102/221) remote: Compressing objects: 47% (104/221) remote: Compressing objects: 48% (107/221) remote: Compressing objects: 49% (109/221) remote: Compressing objects: 50% (111/221) remote: Compressing objects: 51% (113/221) remote: Compressing objects: 52% (115/221) remote: Compressing objects: 53% (118/221) remote: Compressing objects: 54% (120/221) remote: Compressing objects: 55% (122/221) remote: Compressing objects: 56% (124/221) remote: Compressing objects: 57% (126/221) remote: Compressing objects: 58% (129/221) remote: Compressing objects: 59% (131/221) remote: Compressing objects: 60% (133/221) remote: Compressing objects: 61% (135/221) remote: Compressing objects: 62% (138/221) remote: Compressing objects: 63% (140/221) remote: Compressing objects: 64% (142/221) remote: Compressing objects: 65% (144/221) remote: Compressing objects: 66% (146/221) remote: Compressing objects: 67% (149/221) remote: Compressing objects: 68% (151/221) remote: Compressing objects: 69% (153/221) remote: Compressing objects: 70% (155/221) remote: Compressing objects: 71% (157/221) remote: Compressing objects: 72% (160/221) remote: Compressing objects: 73% (162/221) remote: Compressing objects: 74% (164/221) remote: Compressing objects: 75% (166/221) remote: Compressing objects: 76% (168/221) remote: Compressing objects: 77% (171/221) remote: Compressing objects: 78% (173/221) remote: Compressing objects: 79% (175/221) remote: Compressing objects: 80% (177/221) remote: Compressing objects: 81% (180/221) remote: Compressing objects: 82% (182/221) remote: Compressing objects: 83% (184/221) remote: Compressing objects: 84% (186/221) remote: Compressing objects: 85% (188/221) remote: Compressing objects: 86% (191/221) remote: Compressing objects: 87% (193/221) remote: Compressing objects: 88% (195/221) remote: Compressing objects: 89% (197/221) remote: Compressing objects: 90% (199/221) remote: Compressing objects: 91% (202/221) remote: Compressing objects: 92% (204/221) remote: Compressing objects: 93% (206/221) remote: Compressing objects: 94% (208/221) remote: Compressing objects: 95% (210/221) remote: Compressing objects: 96% (213/221) remote: Compressing objects: 97% (215/221) remote: Compressing objects: 98% (217/221) remote: Compressing objects: 99% (219/221) remote: Compressing objects: 100% (221/221) remote: Compressing objects: 100% (221/221), done.
Receiving objects: 0% (1/2358) Receiving objects: 1% (24/2358) Receiving objects: 2% (48/2358) Receiving objects: 3% (71/2358) Receiving objects: 4% (95/2358) Receiving objects: 5% (118/2358) Receiving objects: 6% (142/2358) Receiving objects: 7% (166/2358) Receiving objects: 8% (189/2358) Receiving objects: 9% (213/2358) Receiving objects: 10% (236/2358) Receiving objects: 11% (260/2358) Receiving objects: 12% (283/2358) Receiving objects: 13% (307/2358) Receiving objects: 14% (331/2358) Receiving objects: 15% (354/2358) Receiving objects: 16% (378/2358) Receiving objects: 17% (401/2358) Receiving objects: 18% (425/2358) Receiving objects: 19% (449/2358) Receiving objects: 20% (472/2358) Receiving objects: 21% (496/2358) Receiving objects: 22% (519/2358) Receiving objects: 23% (543/2358) Receiving objects: 24% (566/2358) Receiving objects: 25% (590/2358) Receiving objects: 26% (614/2358) Receiving objects: 27% (637/2358) Receiving objects: 28% (661/2358) Receiving objects: 29% (684/2358) Receiving objects: 30% (708/2358) Receiving objects: 31% (731/2358) Receiving objects: 32% (755/2358) Receiving objects: 33% (779/2358) Receiving objects: 34% (802/2358) Receiving objects: 35% (826/2358) Receiving objects: 36% (849/2358) Receiving objects: 37% (873/2358) Receiving objects: 38% (897/2358) Receiving objects: 39% (920/2358) Receiving objects: 40% (944/2358) Receiving objects: 41% (967/2358) Receiving objects: 42% (991/2358) Receiving objects: 43% (1014/2358) Receiving objects: 44% (1038/2358) Receiving objects: 45% (1062/2358) Receiving objects: 46% (1085/2358) Receiving objects: 47% (1109/2358) Receiving objects: 48% (1132/2358) Receiving objects: 49% (1156/2358) Receiving objects: 50% (1179/2358) Receiving objects: 51% (1203/2358) Receiving objects: 52% (1227/2358) Receiving objects: 53% (1250/2358) Receiving objects: 54% (1274/2358) Receiving objects: 55% (1297/2358) Receiving objects: 56% (1321/2358) Receiving objects: 57% (1345/2358) Receiving objects: 58% (1368/2358) Receiving objects: 59% (1392/2358) Receiving objects: 60% (1415/2358) Receiving objects: 61% (1439/2358) Receiving objects: 62% (1462/2358) Receiving objects: 63% (1486/2358) Receiving objects: 64% (1510/2358) Receiving objects: 65% (1533/2358) Receiving objects: 66% (1557/2358) Receiving objects: 67% (1580/2358) Receiving objects: 68% (1604/2358) Receiving objects: 69% (1628/2358) Receiving objects: 70% (1651/2358) Receiving objects: 71% (1675/2358) Receiving objects: 72% (1698/2358) Receiving objects: 73% (1722/2358) Receiving objects: 74% (1745/2358) Receiving objects: 75% (1769/2358) Receiving objects: 76% (1793/2358) Receiving objects: 77% (1816/2358) Receiving objects: 78% (1840/2358) Receiving objects: 79% (1863/2358) Receiving objects: 80% (1887/2358) Receiving objects: 81% (1910/2358) Receiving objects: 82% (1934/2358) Receiving objects: 83% (1958/2358) Receiving objects: 84% (1981/2358) Receiving objects: 85% (2005/2358) Receiving objects: 86% (2028/2358) Receiving objects: 87% (2052/2358) Receiving objects: 88% (2076/2358) Receiving objects: 89% (2099/2358) Receiving objects: 90% (2123/2358) Receiving objects: 91% (2146/2358) Receiving objects: 92% (2170/2358) Receiving objects: 93% (2193/2358) Receiving objects: 94% (2217/2358) Receiving objects: 95% (2241/2358) remote: Total 2358 (delta 850), reused 758 (delta 758), pack-reused 1273
Receiving objects: 96% (2264/2358) Receiving objects: 97% (2288/2358) Receiving objects: 98% (2311/2358) Receiving objects: 99% (2335/2358) Receiving objects: 100% (2358/2358) Receiving objects: 100% (2358/2358), 330.71 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/887) Resolving deltas: 1% (9/887) Resolving deltas: 2% (19/887) Resolving deltas: 3% (30/887) Resolving deltas: 4% (37/887) Resolving deltas: 5% (49/887) Resolving deltas: 6% (56/887) Resolving deltas: 7% (64/887) Resolving deltas: 9% (82/887) Resolving deltas: 10% (91/887) Resolving deltas: 11% (98/887) Resolving deltas: 12% (107/887) Resolving deltas: 14% (129/887) Resolving deltas: 15% (138/887) Resolving deltas: 17% (152/887) Resolving deltas: 18% (163/887) Resolving deltas: 22% (196/887) Resolving deltas: 23% (206/887) Resolving deltas: 24% (217/887) Resolving deltas: 25% (223/887) Resolving deltas: 26% (232/887) Resolving deltas: 27% (240/887) Resolving deltas: 28% (250/887) Resolving deltas: 29% (258/887) Resolving deltas: 30% (267/887) Resolving deltas: 31% (276/887) Resolving deltas: 32% (284/887) Resolving deltas: 33% (295/887) Resolving deltas: 34% (303/887) Resolving deltas: 35% (313/887) Resolving deltas: 36% (320/887) Resolving deltas: 37% (329/887) Resolving deltas: 38% (339/887) Resolving deltas: 39% (351/887) Resolving deltas: 40% (355/887) Resolving deltas: 41% (364/887) Resolving deltas: 42% (380/887) Resolving deltas: 43% (383/887) Resolving deltas: 44% (393/887) Resolving deltas: 45% (405/887) Resolving deltas: 46% (410/887) Resolving deltas: 48% (426/887) Resolving deltas: 49% (435/887) Resolving deltas: 50% (444/887) Resolving deltas: 51% (454/887) Resolving deltas: 52% (467/887) Resolving deltas: 53% (472/887) Resolving deltas: 54% (479/887) Resolving deltas: 55% (488/887) Resolving deltas: 56% (497/887) Resolving deltas: 57% (506/887) Resolving deltas: 58% (517/887) Resolving deltas: 59% (525/887) Resolving deltas: 60% (533/887) Resolving deltas: 61% (542/887) Resolving deltas: 62% (550/887) Resolving deltas: 63% (560/887) Resolving deltas: 64% (568/887) Resolving deltas: 65% (578/887) Resolving deltas: 66% (586/887) Resolving deltas: 67% (596/887) Resolving deltas: 68% (604/887) Resolving deltas: 69% (614/887) Resolving deltas: 70% (622/887) Resolving deltas: 71% (630/887) Resolving deltas: 72% (640/887) Resolving deltas: 73% (649/887) Resolving deltas: 74% (657/887) Resolving deltas: 75% (667/887) Resolving deltas: 76% (676/887) Resolving deltas: 77% (686/887) Resolving deltas: 78% (694/887) Resolving deltas: 79% (703/887) Resolving deltas: 80% (710/887) Resolving deltas: 81% (720/887) Resolving deltas: 82% (728/887) Resolving deltas: 83% (738/887) Resolving deltas: 84% (746/887) Resolving deltas: 85% (755/887) Resolving deltas: 86% (763/887) Resolving deltas: 87% (773/887) Resolving deltas: 88% (781/887) Resolving deltas: 89% (790/887) Resolving deltas: 90% (799/887) Resolving deltas: 91% (808/887) Resolving deltas: 92% (818/887) Resolving deltas: 93% (825/887) Resolving deltas: 94% (837/887) Resolving deltas: 95% (843/887) Resolving deltas: 96% (853/887) Resolving deltas: 97% (861/887) Resolving deltas: 98% (870/887) Resolving deltas: 99% (879/887) Resolving deltas: 100% (887/887) Resolving deltas: 100% (887/887), completed with 348 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2357/merge: No such file or directory
! 5bb5b6d...ef7fb12 refs/pull/2357/merge -> origin/pr/2357/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! 251f88d...49f6c1a refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! 33d8a6e...fc7e7c8 refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 4cc83d7...6a173ff refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! 7f95e55...e77af3d refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2403/merge: No such file or directory
! e9bf169...d3466d6 refs/pull/2403/merge -> origin/pr/2403/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 6c783c7...97b8bb7 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2464/merge: No such file or directory
! d4e537d...3f5fdfa refs/pull/2464/merge -> origin/pr/2464/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! a9ffe52...768927c refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 7079a6f...1fdb7fe refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6552707196228450310.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6315119123645863314.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2535287405528515827.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2000769867364109042.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 06:01:47,308 30b4bb3a MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/30b4bb3a/pkb.log
2017-04-17 06:01:47,308 30b4bb3a MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-17 06:01:47,309 30b4bb3a MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 06:01:47,768 30b4bb3a MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 06:01:48,081 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 06:01:48,083 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 06:01:48,083 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 06:01:48,088 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 06:01:48,090 30b4bb3a MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 06:01:48,117 30b4bb3a MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 06:01:48,117 30b4bb3a MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/30b4bb3a/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #317
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/317/display/redirect>
------------------------------------------
[...truncated 236.50 KB...]
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 2061, done.
remote: Compressing objects: 0% (1/232) remote: Compressing objects: 1% (3/232) remote: Compressing objects: 2% (5/232) remote: Compressing objects: 3% (7/232) remote: Compressing objects: 4% (10/232) remote: Compressing objects: 5% (12/232) remote: Compressing objects: 6% (14/232) remote: Compressing objects: 7% (17/232) remote: Compressing objects: 8% (19/232) remote: Compressing objects: 9% (21/232) remote: Compressing objects: 10% (24/232) remote: Compressing objects: 11% (26/232) remote: Compressing objects: 12% (28/232) remote: Compressing objects: 13% (31/232) remote: Compressing objects: 14% (33/232) remote: Compressing objects: 15% (35/232) remote: Compressing objects: 16% (38/232) remote: Compressing objects: 17% (40/232) remote: Compressing objects: 18% (42/232) remote: Compressing objects: 19% (45/232) remote: Compressing objects: 20% (47/232) remote: Compressing objects: 21% (49/232) remote: Compressing objects: 22% (52/232) remote: Compressing objects: 23% (54/232) remote: Compressing objects: 24% (56/232) remote: Compressing objects: 25% (58/232) remote: Compressing objects: 26% (61/232) remote: Compressing objects: 27% (63/232) remote: Compressing objects: 28% (65/232) remote: Compressing objects: 29% (68/232) remote: Compressing objects: 30% (70/232) remote: Compressing objects: 31% (72/232) remote: Compressing objects: 32% (75/232) remote: Compressing objects: 33% (77/232) remote: Compressing objects: 34% (79/232) remote: Compressing objects: 35% (82/232) remote: Compressing objects: 36% (84/232) remote: Compressing objects: 37% (86/232) remote: Compressing objects: 38% (89/232) remote: Compressing objects: 39% (91/232) remote: Compressing objects: 40% (93/232) remote: Compressing objects: 41% (96/232) remote: Compressing objects: 42% (98/232) remote: Compressing objects: 43% (100/232) remote: Compressing objects: 44% (103/232) remote: Compressing objects: 45% (105/232) remote: Compressing objects: 46% (107/232) remote: Compressing objects: 47% (110/232) remote: Compressing objects: 48% (112/232) remote: Compressing objects: 49% (114/232) remote: Compressing objects: 50% (116/232) remote: Compressing objects: 51% (119/232) remote: Compressing objects: 52% (121/232) remote: Compressing objects: 53% (123/232) remote: Compressing objects: 54% (126/232) remote: Compressing objects: 55% (128/232) remote: Compressing objects: 56% (130/232) remote: Compressing objects: 57% (133/232) remote: Compressing objects: 58% (135/232) remote: Compressing objects: 59% (137/232) remote: Compressing objects: 60% (140/232) remote: Compressing objects: 61% (142/232) remote: Compressing objects: 62% (144/232) remote: Compressing objects: 63% (147/232) remote: Compressing objects: 64% (149/232) remote: Compressing objects: 65% (151/232) remote: Compressing objects: 66% (154/232) remote: Compressing objects: 67% (156/232) remote: Compressing objects: 68% (158/232) remote: Compressing objects: 69% (161/232) remote: Compressing objects: 70% (163/232) remote: Compressing objects: 71% (165/232) remote: Compressing objects: 72% (168/232) remote: Compressing objects: 73% (170/232) remote: Compressing objects: 74% (172/232) remote: Compressing objects: 75% (174/232) remote: Compressing objects: 76% (177/232) remote: Compressing objects: 77% (179/232) remote: Compressing objects: 78% (181/232) remote: Compressing objects: 79% (184/232) remote: Compressing objects: 80% (186/232) remote: Compressing objects: 81% (188/232) remote: Compressing objects: 82% (191/232) remote: Compressing objects: 83% (193/232) remote: Compressing objects: 84% (195/232) remote: Compressing objects: 85% (198/232) remote: Compressing objects: 86% (200/232) remote: Compressing objects: 87% (202/232) remote: Compressing objects: 88% (205/232) remote: Compressing objects: 89% (207/232) remote: Compressing objects: 90% (209/232) remote: Compressing objects: 91% (212/232) remote: Compressing objects: 92% (214/232) remote: Compressing objects: 93% (216/232) remote: Compressing objects: 94% (219/232) remote: Compressing objects: 95% (221/232) remote: Compressing objects: 96% (223/232) remote: Compressing objects: 97% (226/232) remote: Compressing objects: 98% (228/232) remote: Compressing objects: 99% (230/232) remote: Compressing objects: 100% (232/232) remote: Compressing objects: 100% (232/232), done.
Receiving objects: 0% (1/2061) Receiving objects: 1% (21/2061) Receiving objects: 2% (42/2061) Receiving objects: 3% (62/2061) Receiving objects: 4% (83/2061) Receiving objects: 5% (104/2061) Receiving objects: 6% (124/2061) Receiving objects: 7% (145/2061) Receiving objects: 8% (165/2061) Receiving objects: 9% (186/2061) Receiving objects: 10% (207/2061) Receiving objects: 11% (227/2061) Receiving objects: 12% (248/2061) Receiving objects: 13% (268/2061) Receiving objects: 14% (289/2061) Receiving objects: 15% (310/2061) Receiving objects: 16% (330/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 17% (351/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 18% (371/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 19% (392/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 20% (413/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 21% (433/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 22% (454/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 23% (475/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 24% (495/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 25% (516/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 26% (536/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 27% (557/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 28% (578/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 29% (598/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 30% (619/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 31% (639/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 32% (660/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 33% (681/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 34% (701/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 35% (722/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 36% (742/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 37% (763/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 38% (784/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 39% (804/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 40% (825/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 41% (846/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 42% (866/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 43% (887/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 44% (907/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 45% (928/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 46% (949/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 46% (964/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 47% (969/2061), 28.01 KiB | 46.00 KiB/s Receiving objects: 48% (990/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 49% (1010/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 50% (1031/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 51% (1052/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 52% (1072/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 53% (1093/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 54% (1113/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 55% (1134/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 56% (1155/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 57% (1175/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 58% (1196/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 59% (1216/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 60% (1237/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 61% (1258/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 62% (1278/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 63% (1299/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 64% (1320/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 65% (1340/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 66% (1361/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 67% (1381/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 68% (1402/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 69% (1423/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 70% (1443/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 71% (1464/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 72% (1484/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 73% (1505/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 74% (1526/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 75% (1546/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 76% (1567/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 77% (1587/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 78% (1608/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 79% (1629/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 80% (1649/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 81% (1670/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 82% (1691/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 83% (1711/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 84% (1732/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 85% (1752/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 86% (1773/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 87% (1794/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 88% (1814/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 89% (1835/2061), 72.01 KiB | 64.00 KiB/s remote: Total 2061 (delta 725), reused 631 (delta 631), pack-reused 1073
Receiving objects: 90% (1855/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 91% (1876/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 92% (1897/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 93% (1917/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 94% (1938/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 95% (1958/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 96% (1979/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 97% (2000/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 98% (2020/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 99% (2041/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 100% (2061/2061), 72.01 KiB | 64.00 KiB/s Receiving objects: 100% (2061/2061), 340.03 KiB | 64.00 KiB/s, done.
Resolving deltas: 0% (0/751) Resolving deltas: 1% (8/751) Resolving deltas: 2% (17/751) Resolving deltas: 3% (23/751) Resolving deltas: 4% (36/751) Resolving deltas: 5% (42/751) Resolving deltas: 6% (49/751) Resolving deltas: 8% (67/751) Resolving deltas: 9% (73/751) Resolving deltas: 10% (81/751) Resolving deltas: 11% (89/751) Resolving deltas: 12% (91/751) Resolving deltas: 13% (102/751) Resolving deltas: 14% (107/751) Resolving deltas: 15% (115/751) Resolving deltas: 16% (121/751) Resolving deltas: 17% (130/751) Resolving deltas: 18% (141/751) Resolving deltas: 19% (147/751) Resolving deltas: 20% (152/751) Resolving deltas: 23% (175/751) Resolving deltas: 24% (182/751) Resolving deltas: 25% (189/751) Resolving deltas: 26% (196/751) Resolving deltas: 27% (204/751) Resolving deltas: 28% (211/751) Resolving deltas: 29% (218/751) Resolving deltas: 30% (226/751) Resolving deltas: 31% (236/751) Resolving deltas: 32% (243/751) Resolving deltas: 33% (248/751) Resolving deltas: 34% (256/751) Resolving deltas: 35% (264/751) Resolving deltas: 36% (271/751) Resolving deltas: 37% (279/751) Resolving deltas: 38% (288/751) Resolving deltas: 39% (294/751) Resolving deltas: 40% (301/751) Resolving deltas: 41% (309/751) Resolving deltas: 42% (321/751) Resolving deltas: 43% (323/751) Resolving deltas: 44% (332/751) Resolving deltas: 45% (338/751) Resolving deltas: 46% (346/751) Resolving deltas: 47% (353/751) Resolving deltas: 48% (361/751) Resolving deltas: 49% (368/751) Resolving deltas: 50% (376/751) Resolving deltas: 51% (388/751) Resolving deltas: 52% (391/751) Resolving deltas: 53% (399/751) Resolving deltas: 54% (406/751) Resolving deltas: 55% (416/751) Resolving deltas: 56% (423/751) Resolving deltas: 57% (429/751) Resolving deltas: 58% (436/751) Resolving deltas: 59% (445/751) Resolving deltas: 60% (452/751) Resolving deltas: 61% (460/751) Resolving deltas: 62% (466/751) Resolving deltas: 63% (474/751) Resolving deltas: 64% (482/751) Resolving deltas: 65% (490/751) Resolving deltas: 66% (498/751) Resolving deltas: 67% (506/751) Resolving deltas: 68% (514/751) Resolving deltas: 69% (520/751) Resolving deltas: 70% (526/751) Resolving deltas: 71% (535/751) Resolving deltas: 72% (541/751) Resolving deltas: 73% (549/751) Resolving deltas: 74% (556/751) Resolving deltas: 75% (566/751) Resolving deltas: 76% (574/751) Resolving deltas: 77% (580/751) Resolving deltas: 78% (586/751) Resolving deltas: 79% (594/751) Resolving deltas: 80% (602/751) Resolving deltas: 81% (610/751) Resolving deltas: 82% (616/751) Resolving deltas: 83% (624/751) Resolving deltas: 84% (631/751) Resolving deltas: 85% (639/751) Resolving deltas: 86% (647/751) Resolving deltas: 87% (654/751) Resolving deltas: 88% (661/751) Resolving deltas: 89% (669/751) Resolving deltas: 90% (676/751) Resolving deltas: 91% (684/751) Resolving deltas: 92% (692/751) Resolving deltas: 93% (705/751) Resolving deltas: 94% (707/751) Resolving deltas: 95% (714/751) Resolving deltas: 96% (721/751) Resolving deltas: 97% (729/751) Resolving deltas: 98% (738/751) Resolving deltas: 99% (744/751) Resolving deltas: 100% (751/751) Resolving deltas: 100% (751/751), completed with 296 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2330/head: No such file or directory
! 511a130...447306d refs/pull/2330/head -> origin/pr/2330/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2330/merge: No such file or directory
! 5d4c028...6a9103e refs/pull/2330/merge -> origin/pr/2330/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
* [new ref] refs/pull/2548/head -> origin/pr/2548/head
* [new ref] refs/pull/2548/merge -> origin/pr/2548/merge
* [new ref] refs/pull/2550/head -> origin/pr/2550/head
* [new ref] refs/pull/2550/merge -> origin/pr/2550/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1799)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1525)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:65)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:316)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor862.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy103.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson441205929294293243.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5662280072032797148.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3937865616681008762.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1921353125915777668.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-17 00:02:34,646 043c10b6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/043c10b6/pkb.log
2017-04-17 00:02:34,646 043c10b6 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-17 00:02:34,647 043c10b6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-17 00:02:34,889 043c10b6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-17 00:02:35,055 043c10b6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-17 00:02:35,059 043c10b6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-17 00:02:35,059 043c10b6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-17 00:02:35,069 043c10b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-17 00:02:35,073 043c10b6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-17 00:02:35,115 043c10b6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-17 00:02:35,115 043c10b6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/043c10b6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #316
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/316/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8832221214566515910.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5194141463253808259.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3254176213718755422.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4785452911665300387.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 18:00:32,774 32171fa7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/32171fa7/pkb.log
2017-04-16 18:00:32,774 32171fa7 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 18:00:32,775 32171fa7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 18:00:33,051 32171fa7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 18:00:33,135 32171fa7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 18:00:33,137 32171fa7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 18:00:33,138 32171fa7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 18:00:33,142 32171fa7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 18:00:33,144 32171fa7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 18:00:33,170 32171fa7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 18:00:33,171 32171fa7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/32171fa7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #315
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/315/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1649851872837743095.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7042953185599809301.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7033487597033360959.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6530248442843771628.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 12:44:07,682 dc8cbce5 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/dc8cbce5/pkb.log
2017-04-16 12:44:07,683 dc8cbce5 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 12:44:07,683 dc8cbce5 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 12:44:07,843 dc8cbce5 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 12:44:07,922 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 12:44:07,925 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 12:44:07,925 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 12:44:07,929 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 12:44:07,931 dc8cbce5 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 12:44:07,959 dc8cbce5 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 12:44:07,959 dc8cbce5 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/dc8cbce5/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #314
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/314/display/redirect>
------------------------------------------
[...truncated 236.00 KB...]
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1941, done.
remote: Compressing objects: 0% (1/158) remote: Compressing objects: 1% (2/158) remote: Compressing objects: 2% (4/158) remote: Compressing objects: 3% (5/158) remote: Compressing objects: 4% (7/158) remote: Compressing objects: 5% (8/158) remote: Compressing objects: 6% (10/158) remote: Compressing objects: 7% (12/158) remote: Compressing objects: 8% (13/158) remote: Compressing objects: 9% (15/158) remote: Compressing objects: 10% (16/158) remote: Compressing objects: 11% (18/158) remote: Compressing objects: 12% (19/158) remote: Compressing objects: 13% (21/158) remote: Compressing objects: 14% (23/158) remote: Compressing objects: 15% (24/158) remote: Compressing objects: 16% (26/158) remote: Compressing objects: 17% (27/158) remote: Compressing objects: 18% (29/158) remote: Compressing objects: 19% (31/158) remote: Compressing objects: 20% (32/158) remote: Compressing objects: 21% (34/158) remote: Compressing objects: 22% (35/158) remote: Compressing objects: 23% (37/158) remote: Compressing objects: 24% (38/158) remote: Compressing objects: 25% (40/158) remote: Compressing objects: 26% (42/158) remote: Compressing objects: 27% (43/158) remote: Compressing objects: 28% (45/158) remote: Compressing objects: 29% (46/158) remote: Compressing objects: 30% (48/158) remote: Compressing objects: 31% (49/158) remote: Compressing objects: 32% (51/158) remote: Compressing objects: 33% (53/158) remote: Compressing objects: 34% (54/158) remote: Compressing objects: 35% (56/158) remote: Compressing objects: 36% (57/158) remote: Compressing objects: 37% (59/158) remote: Compressing objects: 38% (61/158) remote: Compressing objects: 39% (62/158) remote: Compressing objects: 40% (64/158) remote: Compressing objects: 41% (65/158) remote: Compressing objects: 42% (67/158) remote: Compressing objects: 43% (68/158) remote: Compressing objects: 44% (70/158) remote: Compressing objects: 45% (72/158) remote: Compressing objects: 46% (73/158) remote: Compressing objects: 47% (75/158) remote: Compressing objects: 48% (76/158) remote: Compressing objects: 49% (78/158) remote: Compressing objects: 50% (79/158) remote: Compressing objects: 51% (81/158) remote: Compressing objects: 52% (83/158) remote: Compressing objects: 53% (84/158) remote: Compressing objects: 54% (86/158) remote: Compressing objects: 55% (87/158) remote: Compressing objects: 56% (89/158) remote: Compressing objects: 57% (91/158) remote: Compressing objects: 58% (92/158) remote: Compressing objects: 59% (94/158) remote: Compressing objects: 60% (95/158) remote: Compressing objects: 61% (97/158) remote: Compressing objects: 62% (98/158) remote: Compressing objects: 63% (100/158) remote: Compressing objects: 64% (102/158) remote: Compressing objects: 65% (103/158) remote: Compressing objects: 66% (105/158) remote: Compressing objects: 67% (106/158) remote: Compressing objects: 68% (108/158) remote: Compressing objects: 69% (110/158) remote: Compressing objects: 70% (111/158) remote: Compressing objects: 71% (113/158) remote: Compressing objects: 72% (114/158) remote: Compressing objects: 73% (116/158) remote: Compressing objects: 74% (117/158) remote: Compressing objects: 75% (119/158) remote: Compressing objects: 76% (121/158) remote: Compressing objects: 77% (122/158) remote: Compressing objects: 78% (124/158) remote: Compressing objects: 79% (125/158) remote: Compressing objects: 80% (127/158) remote: Compressing objects: 81% (128/158) remote: Compressing objects: 82% (130/158) remote: Compressing objects: 83% (132/158) remote: Compressing objects: 84% (133/158) remote: Compressing objects: 85% (135/158) remote: Compressing objects: 86% (136/158) remote: Compressing objects: 87% (138/158) remote: Compressing objects: 88% (140/158) remote: Compressing objects: 89% (141/158) remote: Compressing objects: 90% (143/158) remote: Compressing objects: 91% (144/158) remote: Compressing objects: 92% (146/158) remote: Compressing objects: 93% (147/158) remote: Compressing objects: 94% (149/158) remote: Compressing objects: 95% (151/158) remote: Compressing objects: 96% (152/158) remote: Compressing objects: 97% (154/158) remote: Compressing objects: 98% (155/158) remote: Compressing objects: 99% (157/158) remote: Compressing objects: 100% (158/158) remote: Compressing objects: 100% (158/158), done.
Receiving objects: 0% (1/1941) Receiving objects: 1% (20/1941) Receiving objects: 2% (39/1941) Receiving objects: 3% (59/1941) Receiving objects: 4% (78/1941) Receiving objects: 5% (98/1941) Receiving objects: 6% (117/1941) Receiving objects: 7% (136/1941) Receiving objects: 8% (156/1941) Receiving objects: 9% (175/1941) Receiving objects: 10% (195/1941) Receiving objects: 11% (214/1941) Receiving objects: 12% (233/1941) Receiving objects: 13% (253/1941) Receiving objects: 14% (272/1941) Receiving objects: 15% (292/1941) Receiving objects: 16% (311/1941) Receiving objects: 17% (330/1941) Receiving objects: 18% (350/1941) Receiving objects: 19% (369/1941) Receiving objects: 20% (389/1941) Receiving objects: 21% (408/1941) Receiving objects: 22% (428/1941) Receiving objects: 23% (447/1941) Receiving objects: 24% (466/1941) Receiving objects: 25% (486/1941) Receiving objects: 26% (505/1941) Receiving objects: 27% (525/1941) Receiving objects: 28% (544/1941) Receiving objects: 29% (563/1941) Receiving objects: 30% (583/1941) Receiving objects: 31% (602/1941) Receiving objects: 32% (622/1941) Receiving objects: 33% (641/1941) Receiving objects: 34% (660/1941) Receiving objects: 35% (680/1941) Receiving objects: 36% (699/1941) Receiving objects: 37% (719/1941) Receiving objects: 38% (738/1941) Receiving objects: 39% (757/1941) Receiving objects: 40% (777/1941) Receiving objects: 41% (796/1941) Receiving objects: 42% (816/1941) Receiving objects: 43% (835/1941) Receiving objects: 44% (855/1941) Receiving objects: 45% (874/1941) Receiving objects: 46% (893/1941) Receiving objects: 47% (913/1941) Receiving objects: 48% (932/1941) Receiving objects: 49% (952/1941) Receiving objects: 50% (971/1941) Receiving objects: 51% (990/1941) Receiving objects: 52% (1010/1941) Receiving objects: 53% (1029/1941) Receiving objects: 54% (1049/1941) Receiving objects: 55% (1068/1941) Receiving objects: 56% (1087/1941) Receiving objects: 57% (1107/1941) Receiving objects: 58% (1126/1941) Receiving objects: 59% (1146/1941) Receiving objects: 60% (1165/1941) Receiving objects: 61% (1185/1941) Receiving objects: 62% (1204/1941) Receiving objects: 63% (1223/1941) Receiving objects: 64% (1243/1941) Receiving objects: 65% (1262/1941) Receiving objects: 66% (1282/1941) Receiving objects: 67% (1301/1941) Receiving objects: 68% (1320/1941) Receiving objects: 69% (1340/1941) Receiving objects: 70% (1359/1941) Receiving objects: 71% (1379/1941) Receiving objects: 72% (1398/1941) Receiving objects: 73% (1417/1941) Receiving objects: 74% (1437/1941) Receiving objects: 75% (1456/1941) Receiving objects: 76% (1476/1941) Receiving objects: 77% (1495/1941) Receiving objects: 78% (1514/1941) Receiving objects: 79% (1534/1941) Receiving objects: 80% (1553/1941) Receiving objects: 81% (1573/1941) Receiving objects: 82% (1592/1941) Receiving objects: 83% (1612/1941) Receiving objects: 84% (1631/1941) Receiving objects: 85% (1650/1941) Receiving objects: 86% (1670/1941) Receiving objects: 87% (1689/1941) Receiving objects: 88% (1709/1941) Receiving objects: 89% (1728/1941) Receiving objects: 90% (1747/1941) Receiving objects: 91% (1767/1941) Receiving objects: 92% (1786/1941) Receiving objects: 93% (1806/1941) Receiving objects: 94% (1825/1941) remote: Total 1941 (delta 696), reused 632 (delta 632), pack-reused 1074
Receiving objects: 95% (1844/1941) Receiving objects: 96% (1864/1941) Receiving objects: 97% (1883/1941) Receiving objects: 98% (1903/1941) Receiving objects: 99% (1922/1941) Receiving objects: 100% (1941/1941) Receiving objects: 100% (1941/1941), 257.33 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/719) Resolving deltas: 1% (8/719) Resolving deltas: 2% (15/719) Resolving deltas: 3% (22/719) Resolving deltas: 4% (31/719) Resolving deltas: 5% (41/719) Resolving deltas: 6% (47/719) Resolving deltas: 7% (52/719) Resolving deltas: 8% (59/719) Resolving deltas: 9% (70/719) Resolving deltas: 10% (79/719) Resolving deltas: 11% (80/719) Resolving deltas: 12% (87/719) Resolving deltas: 13% (94/719) Resolving deltas: 15% (108/719) Resolving deltas: 16% (119/719) Resolving deltas: 17% (124/719) Resolving deltas: 19% (142/719) Resolving deltas: 20% (145/719) Resolving deltas: 21% (156/719) Resolving deltas: 22% (162/719) Resolving deltas: 23% (166/719) Resolving deltas: 24% (173/719) Resolving deltas: 25% (180/719) Resolving deltas: 26% (187/719) Resolving deltas: 27% (195/719) Resolving deltas: 28% (203/719) Resolving deltas: 29% (210/719) Resolving deltas: 30% (218/719) Resolving deltas: 31% (223/719) Resolving deltas: 32% (231/719) Resolving deltas: 33% (238/719) Resolving deltas: 34% (246/719) Resolving deltas: 35% (252/719) Resolving deltas: 36% (259/719) Resolving deltas: 37% (268/719) Resolving deltas: 38% (274/719) Resolving deltas: 39% (282/719) Resolving deltas: 40% (288/719) Resolving deltas: 41% (296/719) Resolving deltas: 42% (303/719) Resolving deltas: 43% (310/719) Resolving deltas: 44% (317/719) Resolving deltas: 45% (325/719) Resolving deltas: 46% (335/719) Resolving deltas: 47% (338/719) Resolving deltas: 48% (346/719) Resolving deltas: 49% (355/719) Resolving deltas: 50% (360/719) Resolving deltas: 51% (369/719) Resolving deltas: 52% (379/719) Resolving deltas: 53% (383/719) Resolving deltas: 54% (390/719) Resolving deltas: 55% (396/719) Resolving deltas: 56% (403/719) Resolving deltas: 57% (412/719) Resolving deltas: 58% (419/719) Resolving deltas: 59% (425/719) Resolving deltas: 60% (432/719) Resolving deltas: 61% (439/719) Resolving deltas: 62% (447/719) Resolving deltas: 63% (454/719) Resolving deltas: 64% (462/719) Resolving deltas: 65% (470/719) Resolving deltas: 66% (478/719) Resolving deltas: 67% (482/719) Resolving deltas: 68% (490/719) Resolving deltas: 69% (498/719) Resolving deltas: 70% (505/719) Resolving deltas: 71% (511/719) Resolving deltas: 72% (519/719) Resolving deltas: 73% (526/719) Resolving deltas: 74% (533/719) Resolving deltas: 75% (541/719) Resolving deltas: 76% (548/719) Resolving deltas: 77% (555/719) Resolving deltas: 78% (562/719) Resolving deltas: 79% (570/719) Resolving deltas: 80% (576/719) Resolving deltas: 81% (584/719) Resolving deltas: 82% (590/719) Resolving deltas: 83% (598/719) Resolving deltas: 84% (604/719) Resolving deltas: 85% (612/719) Resolving deltas: 86% (619/719) Resolving deltas: 87% (626/719) Resolving deltas: 88% (633/719) Resolving deltas: 89% (640/719) Resolving deltas: 90% (648/719) Resolving deltas: 91% (655/719) Resolving deltas: 92% (662/719) Resolving deltas: 94% (677/719) Resolving deltas: 95% (684/719) Resolving deltas: 96% (693/719) Resolving deltas: 97% (698/719) Resolving deltas: 98% (706/719) Resolving deltas: 99% (713/719) Resolving deltas: 100% (719/719) Resolving deltas: 100% (719/719), completed with 295 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2457/head: No such file or directory
! 2b57dbf...6da2026 refs/pull/2457/head -> origin/pr/2457/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! c1f2a0c...d158c14 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3073561050663803706.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5106164085112923022.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3489441953458436907.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3948071831209831805.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 06:02:50,510 21cf9cc3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/21cf9cc3/pkb.log
2017-04-16 06:02:50,510 21cf9cc3 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 06:02:50,511 21cf9cc3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 06:02:50,771 21cf9cc3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 06:02:50,861 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 06:02:50,863 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 06:02:50,864 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 06:02:50,870 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 06:02:50,872 21cf9cc3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 06:02:50,894 21cf9cc3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 06:02:50,894 21cf9cc3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/21cf9cc3/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #313
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/313/display/redirect>
------------------------------------------
[...truncated 236.42 KB...]
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1959, done.
remote: Compressing objects: 0% (1/162) remote: Compressing objects: 1% (2/162) remote: Compressing objects: 2% (4/162) remote: Compressing objects: 3% (5/162) remote: Compressing objects: 4% (7/162) remote: Compressing objects: 5% (9/162) remote: Compressing objects: 6% (10/162) remote: Compressing objects: 7% (12/162) remote: Compressing objects: 8% (13/162) remote: Compressing objects: 9% (15/162) remote: Compressing objects: 10% (17/162) remote: Compressing objects: 11% (18/162) remote: Compressing objects: 12% (20/162) remote: Compressing objects: 13% (22/162) remote: Compressing objects: 14% (23/162) remote: Compressing objects: 15% (25/162) remote: Compressing objects: 16% (26/162) remote: Compressing objects: 17% (28/162) remote: Compressing objects: 18% (30/162) remote: Compressing objects: 19% (31/162) remote: Compressing objects: 20% (33/162) remote: Compressing objects: 21% (35/162) remote: Compressing objects: 22% (36/162) remote: Compressing objects: 23% (38/162) remote: Compressing objects: 24% (39/162) remote: Compressing objects: 25% (41/162) remote: Compressing objects: 26% (43/162) remote: Compressing objects: 27% (44/162) remote: Compressing objects: 28% (46/162) remote: Compressing objects: 29% (47/162) remote: Compressing objects: 30% (49/162) remote: Compressing objects: 31% (51/162) remote: Compressing objects: 32% (52/162) remote: Compressing objects: 33% (54/162) remote: Compressing objects: 34% (56/162) remote: Compressing objects: 35% (57/162) remote: Compressing objects: 36% (59/162) remote: Compressing objects: 37% (60/162) remote: Compressing objects: 38% (62/162) remote: Compressing objects: 39% (64/162) remote: Compressing objects: 40% (65/162) remote: Compressing objects: 41% (67/162) remote: Compressing objects: 42% (69/162) remote: Compressing objects: 43% (70/162) remote: Compressing objects: 44% (72/162) remote: Compressing objects: 45% (73/162) remote: Compressing objects: 46% (75/162) remote: Compressing objects: 47% (77/162) remote: Compressing objects: 48% (78/162) remote: Compressing objects: 49% (80/162) remote: Compressing objects: 50% (81/162) remote: Compressing objects: 51% (83/162) remote: Compressing objects: 52% (85/162) remote: Compressing objects: 53% (86/162) remote: Compressing objects: 54% (88/162) remote: Compressing objects: 55% (90/162) remote: Compressing objects: 56% (91/162) remote: Compressing objects: 57% (93/162) remote: Compressing objects: 58% (94/162) remote: Compressing objects: 59% (96/162) remote: Compressing objects: 60% (98/162) remote: Compressing objects: 61% (99/162) remote: Compressing objects: 62% (101/162) remote: Compressing objects: 63% (103/162) remote: Compressing objects: 64% (104/162) remote: Compressing objects: 65% (106/162) remote: Compressing objects: 66% (107/162) remote: Compressing objects: 67% (109/162) remote: Compressing objects: 68% (111/162) remote: Compressing objects: 69% (112/162) remote: Compressing objects: 70% (114/162) remote: Compressing objects: 71% (116/162) remote: Compressing objects: 72% (117/162) remote: Compressing objects: 73% (119/162) remote: Compressing objects: 74% (120/162) remote: Compressing objects: 75% (122/162) remote: Compressing objects: 76% (124/162) remote: Compressing objects: 77% (125/162) remote: Compressing objects: 78% (127/162) remote: Compressing objects: 79% (128/162) remote: Compressing objects: 80% (130/162) remote: Compressing objects: 81% (132/162) remote: Compressing objects: 82% (133/162) remote: Compressing objects: 83% (135/162) remote: Compressing objects: 84% (137/162) remote: Compressing objects: 85% (138/162) remote: Compressing objects: 86% (140/162) remote: Compressing objects: 87% (141/162) remote: Compressing objects: 88% (143/162) remote: Compressing objects: 89% (145/162) remote: Compressing objects: 90% (146/162) remote: Compressing objects: 91% (148/162) remote: Compressing objects: 92% (150/162) remote: Compressing objects: 93% (151/162) remote: Compressing objects: 94% (153/162) remote: Compressing objects: 95% (154/162) remote: Compressing objects: 96% (156/162) remote: Compressing objects: 97% (158/162) remote: Compressing objects: 98% (159/162) remote: Compressing objects: 99% (161/162) remote: Compressing objects: 100% (162/162) remote: Compressing objects: 100% (162/162), done.
Receiving objects: 0% (1/1959) Receiving objects: 1% (20/1959) Receiving objects: 2% (40/1959) Receiving objects: 3% (59/1959) Receiving objects: 4% (79/1959) Receiving objects: 5% (98/1959) Receiving objects: 6% (118/1959) Receiving objects: 7% (138/1959) Receiving objects: 8% (157/1959) Receiving objects: 9% (177/1959) Receiving objects: 10% (196/1959) Receiving objects: 11% (216/1959) Receiving objects: 12% (236/1959) Receiving objects: 13% (255/1959) Receiving objects: 14% (275/1959) Receiving objects: 15% (294/1959) Receiving objects: 16% (314/1959) Receiving objects: 17% (334/1959) Receiving objects: 18% (353/1959) Receiving objects: 19% (373/1959) Receiving objects: 20% (392/1959) Receiving objects: 21% (412/1959) Receiving objects: 22% (431/1959) Receiving objects: 23% (451/1959) Receiving objects: 24% (471/1959) Receiving objects: 25% (490/1959) Receiving objects: 26% (510/1959) Receiving objects: 27% (529/1959) Receiving objects: 28% (549/1959) Receiving objects: 29% (569/1959) Receiving objects: 30% (588/1959) Receiving objects: 31% (608/1959) Receiving objects: 32% (627/1959) Receiving objects: 33% (647/1959) Receiving objects: 34% (667/1959) Receiving objects: 35% (686/1959) Receiving objects: 36% (706/1959) Receiving objects: 37% (725/1959) Receiving objects: 38% (745/1959) Receiving objects: 39% (765/1959) Receiving objects: 40% (784/1959) Receiving objects: 41% (804/1959) Receiving objects: 42% (823/1959) Receiving objects: 43% (843/1959) Receiving objects: 44% (862/1959) Receiving objects: 45% (882/1959) Receiving objects: 46% (902/1959) Receiving objects: 47% (921/1959) Receiving objects: 48% (941/1959) Receiving objects: 49% (960/1959) Receiving objects: 50% (980/1959) Receiving objects: 51% (1000/1959) Receiving objects: 52% (1019/1959) Receiving objects: 53% (1039/1959) Receiving objects: 54% (1058/1959) Receiving objects: 55% (1078/1959) Receiving objects: 56% (1098/1959) Receiving objects: 57% (1117/1959) Receiving objects: 58% (1137/1959) Receiving objects: 59% (1156/1959) Receiving objects: 60% (1176/1959) Receiving objects: 61% (1195/1959) Receiving objects: 62% (1215/1959) Receiving objects: 63% (1235/1959) Receiving objects: 64% (1254/1959) Receiving objects: 65% (1274/1959) Receiving objects: 66% (1293/1959) Receiving objects: 67% (1313/1959) Receiving objects: 68% (1333/1959) Receiving objects: 69% (1352/1959) Receiving objects: 70% (1372/1959) Receiving objects: 71% (1391/1959) Receiving objects: 72% (1411/1959) Receiving objects: 73% (1431/1959) Receiving objects: 74% (1450/1959) Receiving objects: 75% (1470/1959) Receiving objects: 76% (1489/1959) Receiving objects: 77% (1509/1959) Receiving objects: 78% (1529/1959) Receiving objects: 79% (1548/1959) Receiving objects: 80% (1568/1959) Receiving objects: 81% (1587/1959) Receiving objects: 82% (1607/1959) Receiving objects: 83% (1626/1959) Receiving objects: 84% (1646/1959) Receiving objects: 85% (1666/1959) Receiving objects: 86% (1685/1959) Receiving objects: 87% (1705/1959) Receiving objects: 88% (1724/1959) Receiving objects: 89% (1744/1959) Receiving objects: 90% (1764/1959) Receiving objects: 91% (1783/1959) remote: Total 1959 (delta 701), reused 634 (delta 634), pack-reused 1087
Receiving objects: 92% (1803/1959) Receiving objects: 93% (1822/1959) Receiving objects: 94% (1842/1959) Receiving objects: 95% (1862/1959) Receiving objects: 96% (1881/1959) Receiving objects: 97% (1901/1959) Receiving objects: 98% (1920/1959) Receiving objects: 99% (1940/1959) Receiving objects: 100% (1959/1959) Receiving objects: 100% (1959/1959), 258.36 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/724) Resolving deltas: 1% (8/724) Resolving deltas: 2% (15/724) Resolving deltas: 3% (22/724) Resolving deltas: 4% (29/724) Resolving deltas: 5% (37/724) Resolving deltas: 6% (47/724) Resolving deltas: 7% (53/724) Resolving deltas: 8% (58/724) Resolving deltas: 9% (68/724) Resolving deltas: 10% (74/724) Resolving deltas: 11% (82/724) Resolving deltas: 12% (87/724) Resolving deltas: 13% (98/724) Resolving deltas: 15% (112/724) Resolving deltas: 16% (118/724) Resolving deltas: 17% (128/724) Resolving deltas: 20% (146/724) Resolving deltas: 21% (153/724) Resolving deltas: 22% (160/724) Resolving deltas: 23% (167/724) Resolving deltas: 24% (175/724) Resolving deltas: 25% (181/724) Resolving deltas: 26% (189/724) Resolving deltas: 27% (197/724) Resolving deltas: 28% (203/724) Resolving deltas: 29% (210/724) Resolving deltas: 30% (219/724) Resolving deltas: 31% (225/724) Resolving deltas: 32% (233/724) Resolving deltas: 33% (242/724) Resolving deltas: 34% (250/724) Resolving deltas: 35% (256/724) Resolving deltas: 36% (261/724) Resolving deltas: 37% (269/724) Resolving deltas: 38% (278/724) Resolving deltas: 39% (286/724) Resolving deltas: 40% (292/724) Resolving deltas: 41% (298/724) Resolving deltas: 42% (305/724) Resolving deltas: 43% (314/724) Resolving deltas: 44% (319/724) Resolving deltas: 45% (327/724) Resolving deltas: 46% (339/724) Resolving deltas: 47% (342/724) Resolving deltas: 48% (348/724) Resolving deltas: 49% (359/724) Resolving deltas: 50% (362/724) Resolving deltas: 51% (370/724) Resolving deltas: 52% (377/724) Resolving deltas: 53% (384/724) Resolving deltas: 54% (391/724) Resolving deltas: 55% (400/724) Resolving deltas: 56% (406/724) Resolving deltas: 57% (416/724) Resolving deltas: 58% (421/724) Resolving deltas: 59% (428/724) Resolving deltas: 60% (435/724) Resolving deltas: 61% (442/724) Resolving deltas: 62% (449/724) Resolving deltas: 63% (457/724) Resolving deltas: 64% (465/724) Resolving deltas: 65% (473/724) Resolving deltas: 66% (481/724) Resolving deltas: 67% (489/724) Resolving deltas: 68% (493/724) Resolving deltas: 69% (501/724) Resolving deltas: 70% (508/724) Resolving deltas: 71% (516/724) Resolving deltas: 72% (522/724) Resolving deltas: 73% (529/724) Resolving deltas: 74% (536/724) Resolving deltas: 75% (544/724) Resolving deltas: 76% (551/724) Resolving deltas: 77% (558/724) Resolving deltas: 78% (565/724) Resolving deltas: 79% (573/724) Resolving deltas: 80% (581/724) Resolving deltas: 81% (587/724) Resolving deltas: 82% (594/724) Resolving deltas: 83% (601/724) Resolving deltas: 84% (610/724) Resolving deltas: 85% (616/724) Resolving deltas: 86% (623/724) Resolving deltas: 87% (630/724) Resolving deltas: 88% (639/724) Resolving deltas: 89% (645/724) Resolving deltas: 90% (652/724) Resolving deltas: 91% (659/724) Resolving deltas: 92% (667/724) Resolving deltas: 93% (680/724) Resolving deltas: 94% (682/724) Resolving deltas: 95% (688/724) Resolving deltas: 96% (696/724) Resolving deltas: 97% (704/724) Resolving deltas: 98% (710/724) Resolving deltas: 99% (717/724) Resolving deltas: 100% (724/724) Resolving deltas: 100% (724/724), completed with 299 local objects.
error: unable to resolve reference refs/remotes/origin/pr/1904/merge: No such file or directory
! 4d35f04...82f9665 refs/pull/1904/merge -> origin/pr/1904/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1905/merge: No such file or directory
! 0293686...f60b113 refs/pull/1905/merge -> origin/pr/1905/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2146/merge: No such file or directory
! db88f4f...2899397 refs/pull/2146/merge -> origin/pr/2146/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2294/merge: No such file or directory
! 316c95d...649443f refs/pull/2294/merge -> origin/pr/2294/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2351/merge: No such file or directory
! c052529...19af537 refs/pull/2351/merge -> origin/pr/2351/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2375/merge: No such file or directory
! 6b2cff9...75addeb refs/pull/2375/merge -> origin/pr/2375/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8127513786137412581.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3725894120399473020.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8242639319447963272.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4632952067081403753.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-16 00:02:29,141 987f663c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/987f663c/pkb.log
2017-04-16 00:02:29,141 987f663c MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-16 00:02:29,142 987f663c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-16 00:02:29,376 987f663c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-16 00:02:29,461 987f663c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-16 00:02:29,463 987f663c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-16 00:02:29,464 987f663c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-16 00:02:29,469 987f663c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-16 00:02:29,471 987f663c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-16 00:02:29,496 987f663c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-16 00:02:29,497 987f663c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/987f663c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #312
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/312/display/redirect>
------------------------------------------
[...truncated 236.00 KB...]
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1921, done.
remote: Compressing objects: 0% (1/133) remote: Compressing objects: 1% (2/133) remote: Compressing objects: 2% (3/133) remote: Compressing objects: 3% (4/133) remote: Compressing objects: 4% (6/133) remote: Compressing objects: 5% (7/133) remote: Compressing objects: 6% (8/133) remote: Compressing objects: 7% (10/133) remote: Compressing objects: 8% (11/133) remote: Compressing objects: 9% (12/133) remote: Compressing objects: 10% (14/133) remote: Compressing objects: 11% (15/133) remote: Compressing objects: 12% (16/133) remote: Compressing objects: 13% (18/133) remote: Compressing objects: 14% (19/133) remote: Compressing objects: 15% (20/133) remote: Compressing objects: 16% (22/133) remote: Compressing objects: 17% (23/133) remote: Compressing objects: 18% (24/133) remote: Compressing objects: 19% (26/133) remote: Compressing objects: 20% (27/133) remote: Compressing objects: 21% (28/133) remote: Compressing objects: 22% (30/133) remote: Compressing objects: 23% (31/133) remote: Compressing objects: 24% (32/133) remote: Compressing objects: 25% (34/133) remote: Compressing objects: 26% (35/133) remote: Compressing objects: 27% (36/133) remote: Compressing objects: 28% (38/133) remote: Compressing objects: 29% (39/133) remote: Compressing objects: 30% (40/133) remote: Compressing objects: 31% (42/133) remote: Compressing objects: 32% (43/133) remote: Compressing objects: 33% (44/133) remote: Compressing objects: 34% (46/133) remote: Compressing objects: 35% (47/133) remote: Compressing objects: 36% (48/133) remote: Compressing objects: 37% (50/133) remote: Compressing objects: 38% (51/133) remote: Compressing objects: 39% (52/133) remote: Compressing objects: 40% (54/133) remote: Compressing objects: 41% (55/133) remote: Compressing objects: 42% (56/133) remote: Compressing objects: 43% (58/133) remote: Compressing objects: 44% (59/133) remote: Compressing objects: 45% (60/133) remote: Compressing objects: 46% (62/133) remote: Compressing objects: 47% (63/133) remote: Compressing objects: 48% (64/133) remote: Compressing objects: 49% (66/133) remote: Compressing objects: 50% (67/133) remote: Compressing objects: 51% (68/133) remote: Compressing objects: 52% (70/133) remote: Compressing objects: 53% (71/133) remote: Compressing objects: 54% (72/133) remote: Compressing objects: 55% (74/133) remote: Compressing objects: 56% (75/133) remote: Compressing objects: 57% (76/133) remote: Compressing objects: 58% (78/133) remote: Compressing objects: 59% (79/133) remote: Compressing objects: 60% (80/133) remote: Compressing objects: 61% (82/133) remote: Compressing objects: 62% (83/133) remote: Compressing objects: 63% (84/133) remote: Compressing objects: 64% (86/133) remote: Compressing objects: 65% (87/133) remote: Compressing objects: 66% (88/133) remote: Compressing objects: 67% (90/133) remote: Compressing objects: 68% (91/133) remote: Compressing objects: 69% (92/133) remote: Compressing objects: 70% (94/133) remote: Compressing objects: 71% (95/133) remote: Compressing objects: 72% (96/133) remote: Compressing objects: 73% (98/133) remote: Compressing objects: 74% (99/133) remote: Compressing objects: 75% (100/133) remote: Compressing objects: 76% (102/133) remote: Compressing objects: 77% (103/133) remote: Compressing objects: 78% (104/133) remote: Compressing objects: 79% (106/133) remote: Compressing objects: 80% (107/133) remote: Compressing objects: 81% (108/133) remote: Compressing objects: 82% (110/133) remote: Compressing objects: 83% (111/133) remote: Compressing objects: 84% (112/133) remote: Compressing objects: 85% (114/133) remote: Compressing objects: 86% (115/133) remote: Compressing objects: 87% (116/133) remote: Compressing objects: 88% (118/133) remote: Compressing objects: 89% (119/133) remote: Compressing objects: 90% (120/133) remote: Compressing objects: 91% (122/133) remote: Compressing objects: 92% (123/133) remote: Compressing objects: 93% (124/133) remote: Compressing objects: 94% (126/133) remote: Compressing objects: 95% (127/133) remote: Compressing objects: 96% (128/133) remote: Compressing objects: 97% (130/133) remote: Compressing objects: 98% (131/133) remote: Compressing objects: 99% (132/133) remote: Compressing objects: 100% (133/133) remote: Compressing objects: 100% (133/133), done.
Receiving objects: 0% (1/1921) Receiving objects: 1% (20/1921) Receiving objects: 2% (39/1921) Receiving objects: 3% (58/1921) Receiving objects: 4% (77/1921) Receiving objects: 5% (97/1921) Receiving objects: 6% (116/1921) Receiving objects: 7% (135/1921) Receiving objects: 8% (154/1921) Receiving objects: 9% (173/1921) Receiving objects: 10% (193/1921) Receiving objects: 11% (212/1921) Receiving objects: 12% (231/1921) Receiving objects: 13% (250/1921) Receiving objects: 14% (269/1921) Receiving objects: 15% (289/1921) Receiving objects: 16% (308/1921) Receiving objects: 17% (327/1921) Receiving objects: 18% (346/1921) Receiving objects: 19% (365/1921) Receiving objects: 20% (385/1921) Receiving objects: 21% (404/1921) Receiving objects: 22% (423/1921) Receiving objects: 23% (442/1921) Receiving objects: 24% (462/1921) Receiving objects: 25% (481/1921) Receiving objects: 26% (500/1921) Receiving objects: 27% (519/1921) Receiving objects: 28% (538/1921) Receiving objects: 29% (558/1921) Receiving objects: 30% (577/1921) Receiving objects: 31% (596/1921) Receiving objects: 32% (615/1921) Receiving objects: 33% (634/1921) Receiving objects: 34% (654/1921) Receiving objects: 35% (673/1921) Receiving objects: 36% (692/1921) Receiving objects: 37% (711/1921) Receiving objects: 38% (730/1921) Receiving objects: 39% (750/1921) Receiving objects: 40% (769/1921) Receiving objects: 41% (788/1921) Receiving objects: 42% (807/1921) Receiving objects: 43% (827/1921) Receiving objects: 44% (846/1921) Receiving objects: 45% (865/1921) Receiving objects: 46% (884/1921) Receiving objects: 47% (903/1921) Receiving objects: 48% (923/1921) Receiving objects: 49% (942/1921) Receiving objects: 50% (961/1921) Receiving objects: 51% (980/1921) Receiving objects: 52% (999/1921) Receiving objects: 53% (1019/1921) Receiving objects: 54% (1038/1921) Receiving objects: 55% (1057/1921) Receiving objects: 56% (1076/1921) Receiving objects: 57% (1095/1921) Receiving objects: 58% (1115/1921) Receiving objects: 59% (1134/1921) Receiving objects: 60% (1153/1921) Receiving objects: 61% (1172/1921) Receiving objects: 62% (1192/1921) Receiving objects: 63% (1211/1921) Receiving objects: 64% (1230/1921) Receiving objects: 65% (1249/1921) Receiving objects: 66% (1268/1921) Receiving objects: 67% (1288/1921) Receiving objects: 68% (1307/1921) Receiving objects: 69% (1326/1921) Receiving objects: 70% (1345/1921) Receiving objects: 71% (1364/1921) Receiving objects: 72% (1384/1921) Receiving objects: 73% (1403/1921) Receiving objects: 74% (1422/1921) Receiving objects: 75% (1441/1921) Receiving objects: 76% (1460/1921) Receiving objects: 77% (1480/1921) Receiving objects: 78% (1499/1921) Receiving objects: 79% (1518/1921) Receiving objects: 80% (1537/1921) Receiving objects: 81% (1557/1921) Receiving objects: 82% (1576/1921) Receiving objects: 83% (1595/1921) Receiving objects: 84% (1614/1921) Receiving objects: 85% (1633/1921) Receiving objects: 86% (1653/1921) Receiving objects: 87% (1672/1921) remote: Total 1921 (delta 690), reused 636 (delta 636), pack-reused 1084
Receiving objects: 88% (1691/1921) Receiving objects: 89% (1710/1921) Receiving objects: 90% (1729/1921) Receiving objects: 91% (1749/1921) Receiving objects: 92% (1768/1921) Receiving objects: 93% (1787/1921) Receiving objects: 94% (1806/1921) Receiving objects: 95% (1825/1921) Receiving objects: 96% (1845/1921) Receiving objects: 97% (1864/1921) Receiving objects: 98% (1883/1921) Receiving objects: 99% (1902/1921) Receiving objects: 100% (1921/1921) Receiving objects: 100% (1921/1921), 250.48 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/713) Resolving deltas: 1% (8/713) Resolving deltas: 2% (15/713) Resolving deltas: 3% (22/713) Resolving deltas: 4% (30/713) Resolving deltas: 5% (36/713) Resolving deltas: 6% (44/713) Resolving deltas: 7% (56/713) Resolving deltas: 8% (62/713) Resolving deltas: 9% (69/713) Resolving deltas: 10% (72/713) Resolving deltas: 11% (84/713) Resolving deltas: 12% (87/713) Resolving deltas: 14% (100/713) Resolving deltas: 15% (108/713) Resolving deltas: 16% (120/713) Resolving deltas: 17% (125/713) Resolving deltas: 18% (130/713) Resolving deltas: 20% (149/713) Resolving deltas: 21% (152/713) Resolving deltas: 22% (157/713) Resolving deltas: 23% (164/713) Resolving deltas: 24% (173/713) Resolving deltas: 25% (179/713) Resolving deltas: 26% (187/713) Resolving deltas: 27% (195/713) Resolving deltas: 28% (201/713) Resolving deltas: 29% (208/713) Resolving deltas: 30% (214/713) Resolving deltas: 31% (223/713) Resolving deltas: 32% (229/713) Resolving deltas: 33% (238/713) Resolving deltas: 34% (246/713) Resolving deltas: 35% (252/713) Resolving deltas: 36% (257/713) Resolving deltas: 37% (265/713) Resolving deltas: 38% (274/713) Resolving deltas: 39% (283/713) Resolving deltas: 40% (289/713) Resolving deltas: 41% (293/713) Resolving deltas: 42% (300/713) Resolving deltas: 43% (310/713) Resolving deltas: 44% (315/713) Resolving deltas: 45% (323/713) Resolving deltas: 46% (328/713) Resolving deltas: 47% (336/713) Resolving deltas: 48% (343/713) Resolving deltas: 49% (355/713) Resolving deltas: 50% (357/713) Resolving deltas: 51% (364/713) Resolving deltas: 52% (373/713) Resolving deltas: 53% (379/713) Resolving deltas: 54% (386/713) Resolving deltas: 55% (396/713) Resolving deltas: 56% (401/713) Resolving deltas: 57% (407/713) Resolving deltas: 58% (414/713) Resolving deltas: 59% (421/713) Resolving deltas: 60% (430/713) Resolving deltas: 61% (435/713) Resolving deltas: 62% (444/713) Resolving deltas: 63% (450/713) Resolving deltas: 64% (458/713) Resolving deltas: 65% (466/713) Resolving deltas: 66% (474/713) Resolving deltas: 67% (478/713) Resolving deltas: 68% (486/713) Resolving deltas: 69% (492/713) Resolving deltas: 70% (501/713) Resolving deltas: 71% (507/713) Resolving deltas: 72% (515/713) Resolving deltas: 73% (522/713) Resolving deltas: 74% (529/713) Resolving deltas: 75% (537/713) Resolving deltas: 76% (542/713) Resolving deltas: 77% (551/713) Resolving deltas: 78% (558/713) Resolving deltas: 79% (564/713) Resolving deltas: 80% (572/713) Resolving deltas: 81% (578/713) Resolving deltas: 82% (585/713) Resolving deltas: 83% (592/713) Resolving deltas: 84% (599/713) Resolving deltas: 85% (607/713) Resolving deltas: 86% (614/713) Resolving deltas: 87% (621/713) Resolving deltas: 88% (628/713) Resolving deltas: 89% (635/713) Resolving deltas: 90% (642/713) Resolving deltas: 91% (649/713) Resolving deltas: 92% (656/713) Resolving deltas: 94% (671/713) Resolving deltas: 95% (678/713) Resolving deltas: 96% (687/713) Resolving deltas: 97% (692/713) Resolving deltas: 98% (700/713) Resolving deltas: 99% (707/713) Resolving deltas: 100% (713/713) Resolving deltas: 100% (713/713), completed with 291 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2508/head: No such file or directory
! 66546ec...3ab7e0d refs/pull/2508/head -> origin/pr/2508/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 927fcfd...0f89790 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list f7d727c0f7ada7a162f5cb73f658ce52f094dd86 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5980049308857655223.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2411134862328243663.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5444168747191397803.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6739736370980007338.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-15 18:02:55,082 a288b19e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/a288b19e/pkb.log
2017-04-15 18:02:55,083 a288b19e MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-15 18:02:55,083 a288b19e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-15 18:02:55,238 a288b19e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-15 18:02:55,333 a288b19e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-15 18:02:55,336 a288b19e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-15 18:02:55,337 a288b19e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-15 18:02:55,343 a288b19e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-15 18:02:55,345 a288b19e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-15 18:02:55,364 a288b19e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-15 18:02:55,365 a288b19e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/a288b19e/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #311
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/311/display/redirect?page=changes>
Changes:
[kirpichov] [BEAM-1915] Removes use of OldDoFn from Apex
[kirpichov] Removes final minor usages of OldDoFn outside OldDoFn itself
------------------------------------------
[...truncated 239.29 KB...]
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 4116, done.
remote: Compressing objects: 0% (1/265) remote: Compressing objects: 1% (3/265) remote: Compressing objects: 2% (6/265) remote: Compressing objects: 3% (8/265) remote: Compressing objects: 4% (11/265) remote: Compressing objects: 5% (14/265) remote: Compressing objects: 6% (16/265) remote: Compressing objects: 7% (19/265) remote: Compressing objects: 8% (22/265) remote: Compressing objects: 9% (24/265) remote: Compressing objects: 10% (27/265) remote: Compressing objects: 11% (30/265) remote: Compressing objects: 12% (32/265) remote: Compressing objects: 13% (35/265) remote: Compressing objects: 14% (38/265) remote: Compressing objects: 15% (40/265) remote: Compressing objects: 16% (43/265) remote: Compressing objects: 17% (46/265) remote: Compressing objects: 18% (48/265) remote: Compressing objects: 19% (51/265) remote: Compressing objects: 20% (53/265) remote: Compressing objects: 21% (56/265) remote: Compressing objects: 22% (59/265) remote: Compressing objects: 23% (61/265) remote: Compressing objects: 24% (64/265) remote: Compressing objects: 25% (67/265) remote: Compressing objects: 26% (69/265) remote: Compressing objects: 27% (72/265) remote: Compressing objects: 28% (75/265) remote: Compressing objects: 29% (77/265) remote: Compressing objects: 30% (80/265) remote: Compressing objects: 31% (83/265) remote: Compressing objects: 32% (85/265) remote: Compressing objects: 33% (88/265) remote: Compressing objects: 34% (91/265) remote: Compressing objects: 35% (93/265) remote: Compressing objects: 36% (96/265) remote: Compressing objects: 37% (99/265) remote: Compressing objects: 38% (101/265) remote: Compressing objects: 39% (104/265) remote: Compressing objects: 40% (106/265) remote: Compressing objects: 41% (109/265) remote: Compressing objects: 42% (112/265) remote: Compressing objects: 43% (114/265) remote: Compressing objects: 44% (117/265) remote: Compressing objects: 45% (120/265) remote: Compressing objects: 46% (122/265) remote: Compressing objects: 47% (125/265) remote: Compressing objects: 48% (128/265) remote: Compressing objects: 49% (130/265) remote: Compressing objects: 50% (133/265) remote: Compressing objects: 51% (136/265) remote: Compressing objects: 52% (138/265) remote: Compressing objects: 53% (141/265) remote: Compressing objects: 54% (144/265) remote: Compressing objects: 55% (146/265) remote: Compressing objects: 56% (149/265) remote: Compressing objects: 57% (152/265) remote: Compressing objects: 58% (154/265) remote: Compressing objects: 59% (157/265) remote: Compressing objects: 60% (159/265) remote: Compressing objects: 61% (162/265) remote: Compressing objects: 62% (165/265) remote: Compressing objects: 63% (167/265) remote: Compressing objects: 64% (170/265) remote: Compressing objects: 65% (173/265) remote: Compressing objects: 66% (175/265) remote: Compressing objects: 67% (178/265) remote: Compressing objects: 68% (181/265) remote: Compressing objects: 69% (183/265) remote: Compressing objects: 70% (186/265) remote: Compressing objects: 71% (189/265) remote: Compressing objects: 72% (191/265) remote: Compressing objects: 73% (194/265) remote: Compressing objects: 74% (197/265) remote: Compressing objects: 75% (199/265) remote: Compressing objects: 76% (202/265) remote: Compressing objects: 77% (205/265) remote: Compressing objects: 78% (207/265) remote: Compressing objects: 79% (210/265) remote: Compressing objects: 80% (212/265) remote: Compressing objects: 81% (215/265) remote: Compressing objects: 82% (218/265) remote: Compressing objects: 83% (220/265) remote: Compressing objects: 84% (223/265) remote: Compressing objects: 85% (226/265) remote: Compressing objects: 86% (228/265) remote: Compressing objects: 87% (231/265) remote: Compressing objects: 88% (234/265) remote: Compressing objects: 89% (236/265) remote: Compressing objects: 90% (239/265) remote: Compressing objects: 91% (242/265) remote: Compressing objects: 92% (244/265) remote: Compressing objects: 93% (247/265) remote: Compressing objects: 94% (250/265) remote: Compressing objects: 95% (252/265) remote: Compressing objects: 96% (255/265) remote: Compressing objects: 97% (258/265) remote: Compressing objects: 98% (260/265) remote: Compressing objects: 99% (263/265) remote: Compressing objects: 100% (265/265) remote: Compressing objects: 100% (265/265), done.
Receiving objects: 0% (1/4116) Receiving objects: 1% (42/4116) Receiving objects: 2% (83/4116) Receiving objects: 3% (124/4116) Receiving objects: 4% (165/4116) Receiving objects: 5% (206/4116) Receiving objects: 6% (247/4116) Receiving objects: 7% (289/4116) Receiving objects: 8% (330/4116) Receiving objects: 9% (371/4116) Receiving objects: 10% (412/4116) Receiving objects: 11% (453/4116) Receiving objects: 12% (494/4116) Receiving objects: 13% (536/4116) Receiving objects: 14% (577/4116) Receiving objects: 15% (618/4116) Receiving objects: 16% (659/4116) Receiving objects: 17% (700/4116) Receiving objects: 18% (741/4116) Receiving objects: 19% (783/4116) Receiving objects: 20% (824/4116) Receiving objects: 21% (865/4116) Receiving objects: 22% (906/4116) Receiving objects: 23% (947/4116) Receiving objects: 24% (988/4116) Receiving objects: 25% (1029/4116) Receiving objects: 26% (1071/4116) Receiving objects: 27% (1112/4116) Receiving objects: 28% (1153/4116) Receiving objects: 29% (1194/4116) Receiving objects: 30% (1235/4116) Receiving objects: 31% (1276/4116) Receiving objects: 32% (1318/4116) Receiving objects: 33% (1359/4116) Receiving objects: 34% (1400/4116) Receiving objects: 35% (1441/4116) Receiving objects: 36% (1482/4116) Receiving objects: 37% (1523/4116) Receiving objects: 38% (1565/4116) Receiving objects: 39% (1606/4116) Receiving objects: 40% (1647/4116) Receiving objects: 41% (1688/4116) Receiving objects: 42% (1729/4116) Receiving objects: 43% (1770/4116) Receiving objects: 44% (1812/4116) Receiving objects: 45% (1853/4116) Receiving objects: 46% (1894/4116) Receiving objects: 47% (1935/4116) Receiving objects: 48% (1976/4116) Receiving objects: 49% (2017/4116) Receiving objects: 50% (2058/4116) Receiving objects: 51% (2100/4116) Receiving objects: 52% (2141/4116) Receiving objects: 53% (2182/4116) Receiving objects: 54% (2223/4116) Receiving objects: 55% (2264/4116) Receiving objects: 56% (2305/4116) Receiving objects: 57% (2347/4116) Receiving objects: 58% (2388/4116) Receiving objects: 59% (2429/4116) Receiving objects: 60% (2470/4116) Receiving objects: 61% (2511/4116) Receiving objects: 62% (2552/4116) Receiving objects: 63% (2594/4116) Receiving objects: 64% (2635/4116) Receiving objects: 65% (2676/4116) Receiving objects: 66% (2717/4116) Receiving objects: 67% (2758/4116) Receiving objects: 68% (2799/4116) Receiving objects: 69% (2841/4116) Receiving objects: 70% (2882/4116) Receiving objects: 71% (2923/4116) Receiving objects: 72% (2964/4116) Receiving objects: 73% (3005/4116) Receiving objects: 74% (3046/4116) Receiving objects: 75% (3087/4116) Receiving objects: 76% (3129/4116) Receiving objects: 77% (3170/4116) Receiving objects: 78% (3211/4116) Receiving objects: 79% (3252/4116) Receiving objects: 80% (3293/4116) Receiving objects: 81% (3334/4116) Receiving objects: 82% (3376/4116) Receiving objects: 83% (3417/4116) Receiving objects: 84% (3458/4116) Receiving objects: 85% (3499/4116) Receiving objects: 86% (3540/4116) Receiving objects: 87% (3581/4116) Receiving objects: 88% (3623/4116) Receiving objects: 89% (3664/4116) Receiving objects: 90% (3705/4116) Receiving objects: 91% (3746/4116) Receiving objects: 92% (3787/4116) remote: Total 4116 (delta 1409), reused 1282 (delta 1282), pack-reused 2438
Receiving objects: 93% (3828/4116) Receiving objects: 94% (3870/4116) Receiving objects: 95% (3911/4116) Receiving objects: 96% (3952/4116) Receiving objects: 97% (3993/4116) Receiving objects: 98% (4034/4116) Receiving objects: 99% (4075/4116) Receiving objects: 100% (4116/4116) Receiving objects: 100% (4116/4116), 555.70 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/1515) Resolving deltas: 1% (18/1515) Resolving deltas: 2% (31/1515) Resolving deltas: 3% (46/1515) Resolving deltas: 4% (64/1515) Resolving deltas: 5% (76/1515) Resolving deltas: 6% (94/1515) Resolving deltas: 7% (108/1515) Resolving deltas: 8% (127/1515) Resolving deltas: 10% (158/1515) Resolving deltas: 11% (177/1515) Resolving deltas: 13% (199/1515) Resolving deltas: 14% (213/1515) Resolving deltas: 15% (233/1515) Resolving deltas: 17% (262/1515) Resolving deltas: 18% (284/1515) Resolving deltas: 19% (300/1515) Resolving deltas: 20% (305/1515) Resolving deltas: 21% (321/1515) Resolving deltas: 22% (336/1515) Resolving deltas: 23% (349/1515) Resolving deltas: 24% (365/1515) Resolving deltas: 25% (384/1515) Resolving deltas: 26% (396/1515) Resolving deltas: 27% (413/1515) Resolving deltas: 28% (427/1515) Resolving deltas: 29% (443/1515) Resolving deltas: 30% (458/1515) Resolving deltas: 31% (471/1515) Resolving deltas: 32% (485/1515) Resolving deltas: 33% (504/1515) Resolving deltas: 34% (519/1515) Resolving deltas: 36% (547/1515) Resolving deltas: 37% (561/1515) Resolving deltas: 38% (577/1515) Resolving deltas: 39% (594/1515) Resolving deltas: 40% (606/1515) Resolving deltas: 41% (625/1515) Resolving deltas: 42% (638/1515) Resolving deltas: 43% (663/1515) Resolving deltas: 44% (673/1515) Resolving deltas: 45% (683/1515) Resolving deltas: 46% (698/1515) Resolving deltas: 47% (724/1515) Resolving deltas: 48% (730/1515) Resolving deltas: 49% (744/1515) Resolving deltas: 50% (758/1515) Resolving deltas: 51% (778/1515) Resolving deltas: 52% (788/1515) Resolving deltas: 53% (804/1515) Resolving deltas: 54% (819/1515) Resolving deltas: 55% (837/1515) Resolving deltas: 56% (849/1515) Resolving deltas: 57% (865/1515) Resolving deltas: 58% (879/1515) Resolving deltas: 59% (894/1515) Resolving deltas: 60% (909/1515) Resolving deltas: 61% (926/1515) Resolving deltas: 62% (941/1515) Resolving deltas: 63% (955/1515) Resolving deltas: 64% (973/1515) Resolving deltas: 65% (986/1515) Resolving deltas: 66% (1001/1515) Resolving deltas: 67% (1021/1515) Resolving deltas: 68% (1039/1515) Resolving deltas: 69% (1046/1515) Resolving deltas: 70% (1073/1515) Resolving deltas: 71% (1076/1515) Resolving deltas: 72% (1091/1515) Resolving deltas: 73% (1111/1515) Resolving deltas: 74% (1122/1515) Resolving deltas: 75% (1137/1515) Resolving deltas: 76% (1152/1515) Resolving deltas: 77% (1167/1515) Resolving deltas: 78% (1186/1515) Resolving deltas: 79% (1197/1515) Resolving deltas: 80% (1212/1515) Resolving deltas: 81% (1228/1515) Resolving deltas: 82% (1244/1515) Resolving deltas: 83% (1259/1515) Resolving deltas: 84% (1273/1515) Resolving deltas: 85% (1288/1515) Resolving deltas: 86% (1304/1515) Resolving deltas: 87% (1320/1515) Resolving deltas: 88% (1335/1515) Resolving deltas: 89% (1357/1515) Resolving deltas: 90% (1364/1515) Resolving deltas: 91% (1379/1515) Resolving deltas: 92% (1395/1515) Resolving deltas: 93% (1409/1515) Resolving deltas: 94% (1428/1515) Resolving deltas: 95% (1442/1515) Resolving deltas: 96% (1455/1515) Resolving deltas: 97% (1473/1515) Resolving deltas: 98% (1489/1515) Resolving deltas: 99% (1500/1515) Resolving deltas: 100% (1515/1515) Resolving deltas: 100% (1515/1515), completed with 472 local objects.
fdbadfc..f7d727c master -> origin/master
error: unable to resolve reference refs/remotes/origin/pr/1687/merge: No such file or directory
! 6d0a5e5...ca1215f refs/pull/1687/merge -> origin/pr/1687/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1725/merge: No such file or directory
! 99b42a1...e023729 refs/pull/1725/merge -> origin/pr/1725/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1729/merge: No such file or directory
! 58d4458...ce49aad refs/pull/1729/merge -> origin/pr/1729/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1851/merge: No such file or directory
! 2b53891...78e4bf9 refs/pull/1851/merge -> origin/pr/1851/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 5a055d5...502da88 refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! 7d15c2c...b0a00bd refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! 0d2dbb8...bec8d58 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! c1f2c4f...eefcb75 refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! 65c5c1b...c53a4a4 refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! 0d1c6da...acb155f refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! a8b0b6a...1e28b4d refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 430fd9a...7f686a9 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! ff4ee2a...890d1ed refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! e35570c...36cb659 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 154eddd...b0927d5 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! cfaebbd...8524d7b refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 9e4e337...457cc80 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 921b0c7...0ec058e refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! fadc16a...557cdc4 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! a30fc3e...92f1d8c refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! d566223...ae4da02 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 3ddc654...f597223 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 39dfef6...c1f2a0c refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! f5ce38f...1eb04db refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! fa9e855...c20273c refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! f9a24c9...b1b8c98 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! d5a9e2b...10bd14d refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/head: No such file or directory
! dd963e1...a3b5f96 refs/pull/2500/head -> origin/pr/2500/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 14aff58...9cc3ca0 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 4e6f83f...927fcfd refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 1eb90fa...aed3bb9 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
* [new ref] refs/pull/2547/head -> origin/pr/2547/head
* [new ref] refs/pull/2547/merge -> origin/pr/2547/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 5b30834...60d65b7 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f7d727c0f7ada7a162f5cb73f658ce52f094dd86 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f7d727c0f7ada7a162f5cb73f658ce52f094dd86
> git rev-list fdbadfc9cceecf645f2325777ab32f1cb3041953 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3647479131195280096.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6046535336187955417.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8788402891526215399.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4014242604697541272.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-15 12:02:49,177 c48054da MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c48054da/pkb.log
2017-04-15 12:02:49,177 c48054da MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-15 12:02:49,177 c48054da MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-15 12:02:49,364 c48054da MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-15 12:02:49,457 c48054da MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-15 12:02:49,460 c48054da MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-15 12:02:49,460 c48054da MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-15 12:02:49,466 c48054da MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-15 12:02:49,468 c48054da MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-15 12:02:49,490 c48054da MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-15 12:02:49,490 c48054da MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c48054da/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #310
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/310/display/redirect>
------------------------------------------
[...truncated 256.20 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! 28801da...1cb42dd refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 44be7cf...498d04f refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! 774167b...ebb426d refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2437/merge: No such file or directory
! 53d38b6...edde66b refs/pull/2437/merge -> origin/pr/2437/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! 1471a14...cd94a1d refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! 563729e...dc8b790 refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2441/merge: No such file or directory
! c9e7b70...3f7d1e4 refs/pull/2441/merge -> origin/pr/2441/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2444/merge: No such file or directory
! 0fa0ac3...766c268 refs/pull/2444/merge -> origin/pr/2444/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! d039def...b78575c refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2451/merge: No such file or directory
! 2556b0c...cb11bb6 refs/pull/2451/merge -> origin/pr/2451/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 6f36f19...9dca2eb refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2454/merge: No such file or directory
! ebc1fcb...9144d16 refs/pull/2454/merge -> origin/pr/2454/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! a3ea6ae...3b8ec12 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2461/merge: No such file or directory
! 7abceed...f50cc7b refs/pull/2461/merge -> origin/pr/2461/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2463/merge: No such file or directory
! d8e1697...9bbf9eb refs/pull/2463/merge -> origin/pr/2463/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2464/merge: No such file or directory
! 62d3eea...d4e537d refs/pull/2464/merge -> origin/pr/2464/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2465/merge: No such file or directory
! b4c447b...1edf2c7 refs/pull/2465/merge -> origin/pr/2465/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2467/merge: No such file or directory
! 3dc8d6b...ce16c1c refs/pull/2467/merge -> origin/pr/2467/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2472/merge: No such file or directory
! 831b2ca...10237ee refs/pull/2472/merge -> origin/pr/2472/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! 178a986...327d4bf refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2477/merge: No such file or directory
! a5f1d39...11070b5 refs/pull/2477/merge -> origin/pr/2477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2480/merge: No such file or directory
! 8ddbefe...e778720 refs/pull/2480/merge -> origin/pr/2480/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 15da1ad...6b2b994 refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! 6e5f06a...e521ab9 refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! a0d9767...e0953a7 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! 09ee9d3...6ed8545 refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2492/merge: No such file or directory
! 25853db...2a683d3 refs/pull/2492/merge -> origin/pr/2492/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! 50ea67f...a11307a refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 6831997...a9ffe52 refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! fc02db1...cb3f078 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! 3f65416...a5be5fb refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! ecf3006...29cae96 refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 0c7767e...d8b33d0 refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 658fc7a...9cc4e4d refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! b6c8397...d646411 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! 6d441b8...a51b9ed refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 8df0158...7079a6f refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 3b6ed4b...4967edf refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
* [new ref] refs/pull/2546/head -> origin/pr/2546/head
* [new ref] refs/pull/2546/merge -> origin/pr/2546/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fdbadfc9cceecf645f2325777ab32f1cb3041953 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fdbadfc9cceecf645f2325777ab32f1cb3041953
> git rev-list fdbadfc9cceecf645f2325777ab32f1cb3041953 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson47892288458463694.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1464290744670214655.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6904416182034810045.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4180425732096873610.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-15 06:02:39,293 a5d0871f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/a5d0871f/pkb.log
2017-04-15 06:02:39,293 a5d0871f MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-15 06:02:39,294 a5d0871f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-15 06:02:39,428 a5d0871f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-15 06:02:39,526 a5d0871f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-15 06:02:39,528 a5d0871f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-15 06:02:39,529 a5d0871f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-15 06:02:39,534 a5d0871f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-15 06:02:39,536 a5d0871f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-15 06:02:39,557 a5d0871f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-15 06:02:39,558 a5d0871f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/a5d0871f/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #309
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/309/display/redirect?page=changes>
Changes:
[tgroh] Add PCollections Utilities
[dhalperi] ApexRunner: register standard IOs when deserializing pipeline options
[dhalperi] Avoi repackaging bigtable classes in dataflow runner.
[altay] [BEAM-1964] Fix lint issues for linter upgrade -2
[altay] [BEAM-1964] Fix lint issues for linter upgrade -3
[tgroh] Rename DoFn.Context#sideOutput to output
[altay] [BEAM-1964] Fix lint issues and pylint upgrade
[tgroh] Update Signature of PTransformOverrideFactory
------------------------------------------
[...truncated 261.51 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! 21442f4...774167b refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! 3d9e766...1471a14 refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! f7cf9e0...563729e refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2441/merge: No such file or directory
! ce97533...c9e7b70 refs/pull/2441/merge -> origin/pr/2441/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 9f60c28...3ddc654 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! dd3a255...d039def refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 13271e4...6f36f19 refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 1f9e3f0...a3ea6ae refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 6428fda...39dfef6 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2461/merge: No such file or directory
! 00efdeb...7abceed refs/pull/2461/merge -> origin/pr/2461/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2464/merge: No such file or directory
! e9ece7e...62d3eea refs/pull/2464/merge -> origin/pr/2464/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2465/merge: No such file or directory
! 1209746...b4c447b refs/pull/2465/merge -> origin/pr/2465/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2467/merge: No such file or directory
! 4c793da...3dc8d6b refs/pull/2467/merge -> origin/pr/2467/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! bfe9cd8...f5ce38f refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! f9610fe...fa9e855 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2480/merge: No such file or directory
! 25129aa...8ddbefe refs/pull/2480/merge -> origin/pr/2480/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 00dc4b6...f9a24c9 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 1820056...15da1ad refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! b9663eb...6e5f06a refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! bf83e88...a0d9767 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! d4e30ab...d5a9e2b refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! ee5fed4...09ee9d3 refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! 52eae97...50ea67f refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 0d0bb75...6831997 refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! d770a09...fc02db1 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! 650a5a5...91015e5 refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/head: No such file or directory
! e5e6e63...2926965 refs/pull/2501/head -> origin/pr/2501/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! b7b8c88...c7b289b refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 2a0d598...ecf3006 refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 6f01db6...0c7767e refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! 8382c3d...7965449 refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 76ca42f...14aff58 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! bbc031b...4e6f83f refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/head: No such file or directory
! d773fbd..9bac351 refs/pull/2509/head -> origin/pr/2509/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! b3a60fb...1eb90fa refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/head: No such file or directory
! 1ab6a9a..36f9d90 refs/pull/2512/head -> origin/pr/2512/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! f45dc4c...6d441b8 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 1f4c150...3b6ed4b refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
* [new ref] refs/pull/2540/head -> origin/pr/2540/head
* [new ref] refs/pull/2540/merge -> origin/pr/2540/merge
* [new ref] refs/pull/2541/head -> origin/pr/2541/head
* [new ref] refs/pull/2541/merge -> origin/pr/2541/merge
* [new ref] refs/pull/2542/head -> origin/pr/2542/head
* [new ref] refs/pull/2542/merge -> origin/pr/2542/merge
* [new ref] refs/pull/2543/head -> origin/pr/2543/head
* [new ref] refs/pull/2543/merge -> origin/pr/2543/merge
* [new ref] refs/pull/2544/head -> origin/pr/2544/head
* [new ref] refs/pull/2544/merge -> origin/pr/2544/merge
* [new ref] refs/pull/2545/head -> origin/pr/2545/head
* [new ref] refs/pull/2545/merge -> origin/pr/2545/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! ca83009...5b30834 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fdbadfc9cceecf645f2325777ab32f1cb3041953 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fdbadfc9cceecf645f2325777ab32f1cb3041953
> git rev-list b2329a7eff1e2b660af1efcc0a58bc54a478bfdd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson267422978756379310.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2971533689719387357.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5463828583138577598.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6974279427301178420.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-15 00:02:52,823 24f0e108 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/24f0e108/pkb.log
2017-04-15 00:02:52,823 24f0e108 MainThread INFO PerfKitBenchmarker version: v1.11.0-40-g1f4031b
2017-04-15 00:02:52,824 24f0e108 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-15 00:02:53,400 24f0e108 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-15 00:02:53,546 24f0e108 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-15 00:02:53,550 24f0e108 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-15 00:02:53,550 24f0e108 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-15 00:02:53,558 24f0e108 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-15 00:02:53,560 24f0e108 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-15 00:02:53,613 24f0e108 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-15 00:02:53,613 24f0e108 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/24f0e108/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #308
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/308/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-1347] Update protos related to State API for prototyping purposes.
[tgroh] Free PTransform Names if they are being Replaced
------------------------------------------
[...truncated 239.50 KB...]
remote: Counting objects: 5579, done.
remote: Compressing objects: 0% (1/460) remote: Compressing objects: 1% (5/460) remote: Compressing objects: 2% (10/460) remote: Compressing objects: 3% (14/460) remote: Compressing objects: 4% (19/460) remote: Compressing objects: 5% (23/460) remote: Compressing objects: 6% (28/460) remote: Compressing objects: 7% (33/460) remote: Compressing objects: 8% (37/460) remote: Compressing objects: 9% (42/460) remote: Compressing objects: 10% (46/460) remote: Compressing objects: 11% (51/460) remote: Compressing objects: 12% (56/460) remote: Compressing objects: 13% (60/460) remote: Compressing objects: 14% (65/460) remote: Compressing objects: 15% (69/460) remote: Compressing objects: 16% (74/460) remote: Compressing objects: 17% (79/460) remote: Compressing objects: 18% (83/460) remote: Compressing objects: 19% (88/460) remote: Compressing objects: 20% (92/460) remote: Compressing objects: 21% (97/460) remote: Compressing objects: 22% (102/460) remote: Compressing objects: 23% (106/460) remote: Compressing objects: 24% (111/460) remote: Compressing objects: 25% (115/460) remote: Compressing objects: 26% (120/460) remote: Compressing objects: 27% (125/460) remote: Compressing objects: 28% (129/460) remote: Compressing objects: 29% (134/460) remote: Compressing objects: 30% (138/460) remote: Compressing objects: 31% (143/460) remote: Compressing objects: 32% (148/460) remote: Compressing objects: 33% (152/460) remote: Compressing objects: 34% (157/460) remote: Compressing objects: 35% (161/460) remote: Compressing objects: 36% (166/460) remote: Compressing objects: 37% (171/460) remote: Compressing objects: 38% (175/460) remote: Compressing objects: 39% (180/460) remote: Compressing objects: 40% (184/460) remote: Compressing objects: 41% (189/460) remote: Compressing objects: 42% (194/460) remote: Compressing objects: 43% (198/460) remote: Compressing objects: 44% (203/460) remote: Compressing objects: 45% (207/460) remote: Compressing objects: 46% (212/460) remote: Compressing objects: 47% (217/460) remote: Compressing objects: 48% (221/460) remote: Compressing objects: 49% (226/460) remote: Compressing objects: 50% (230/460) remote: Compressing objects: 51% (235/460) remote: Compressing objects: 52% (240/460) remote: Compressing objects: 53% (244/460) remote: Compressing objects: 54% (249/460) remote: Compressing objects: 55% (253/460) remote: Compressing objects: 56% (258/460) remote: Compressing objects: 57% (263/460) remote: Compressing objects: 58% (267/460) remote: Compressing objects: 59% (272/460) remote: Compressing objects: 60% (276/460) remote: Compressing objects: 61% (281/460) remote: Compressing objects: 62% (286/460) remote: Compressing objects: 63% (290/460) remote: Compressing objects: 64% (295/460) remote: Compressing objects: 65% (299/460) remote: Compressing objects: 66% (304/460) remote: Compressing objects: 67% (309/460) remote: Compressing objects: 68% (313/460) remote: Compressing objects: 69% (318/460) remote: Compressing objects: 70% (322/460) remote: Compressing objects: 71% (327/460) remote: Compressing objects: 72% (332/460) remote: Compressing objects: 73% (336/460) remote: Compressing objects: 74% (341/460) remote: Compressing objects: 75% (345/460) remote: Compressing objects: 76% (350/460) remote: Compressing objects: 77% (355/460) remote: Compressing objects: 78% (359/460) remote: Compressing objects: 79% (364/460) remote: Compressing objects: 80% (368/460) remote: Compressing objects: 81% (373/460) remote: Compressing objects: 82% (378/460) remote: Compressing objects: 83% (382/460) remote: Compressing objects: 84% (387/460) remote: Compressing objects: 85% (391/460) remote: Compressing objects: 86% (396/460) remote: Compressing objects: 87% (401/460) remote: Compressing objects: 88% (405/460) remote: Compressing objects: 89% (410/460) remote: Compressing objects: 90% (414/460) remote: Compressing objects: 91% (419/460) remote: Compressing objects: 92% (424/460) remote: Compressing objects: 93% (428/460) remote: Compressing objects: 94% (433/460) remote: Compressing objects: 95% (437/460) remote: Compressing objects: 96% (442/460) remote: Compressing objects: 97% (447/460) remote: Compressing objects: 98% (451/460) remote: Compressing objects: 99% (456/460) remote: Compressing objects: 100% (460/460) remote: Compressing objects: 100% (460/460), done.
Receiving objects: 0% (1/5579) Receiving objects: 1% (56/5579) Receiving objects: 2% (112/5579) Receiving objects: 3% (168/5579) Receiving objects: 4% (224/5579) Receiving objects: 5% (279/5579) Receiving objects: 6% (335/5579) Receiving objects: 7% (391/5579) Receiving objects: 8% (447/5579) Receiving objects: 9% (503/5579) Receiving objects: 10% (558/5579) Receiving objects: 11% (614/5579) Receiving objects: 12% (670/5579) Receiving objects: 13% (726/5579) Receiving objects: 14% (782/5579) Receiving objects: 15% (837/5579) Receiving objects: 16% (893/5579) Receiving objects: 17% (949/5579) Receiving objects: 18% (1005/5579) Receiving objects: 19% (1061/5579) Receiving objects: 20% (1116/5579) Receiving objects: 21% (1172/5579) Receiving objects: 22% (1228/5579) Receiving objects: 23% (1284/5579) Receiving objects: 24% (1339/5579) Receiving objects: 25% (1395/5579) Receiving objects: 26% (1451/5579) Receiving objects: 27% (1507/5579) Receiving objects: 28% (1563/5579) Receiving objects: 29% (1618/5579) Receiving objects: 30% (1674/5579) Receiving objects: 31% (1730/5579) Receiving objects: 32% (1786/5579) Receiving objects: 33% (1842/5579) Receiving objects: 34% (1897/5579) Receiving objects: 35% (1953/5579) Receiving objects: 36% (2009/5579) Receiving objects: 37% (2065/5579) Receiving objects: 38% (2121/5579) Receiving objects: 39% (2176/5579) Receiving objects: 40% (2232/5579) Receiving objects: 41% (2288/5579) Receiving objects: 42% (2344/5579) Receiving objects: 43% (2399/5579) Receiving objects: 44% (2455/5579) Receiving objects: 45% (2511/5579) Receiving objects: 46% (2567/5579) Receiving objects: 47% (2623/5579) Receiving objects: 48% (2678/5579) Receiving objects: 49% (2734/5579) Receiving objects: 50% (2790/5579) Receiving objects: 51% (2846/5579) Receiving objects: 52% (2902/5579) Receiving objects: 53% (2957/5579) Receiving objects: 54% (3013/5579) Receiving objects: 55% (3069/5579) Receiving objects: 56% (3125/5579) Receiving objects: 57% (3181/5579) Receiving objects: 58% (3236/5579) Receiving objects: 59% (3292/5579) Receiving objects: 60% (3348/5579) Receiving objects: 61% (3404/5579) Receiving objects: 62% (3459/5579) Receiving objects: 63% (3515/5579) Receiving objects: 64% (3571/5579) Receiving objects: 65% (3627/5579) Receiving objects: 66% (3683/5579) Receiving objects: 67% (3738/5579) Receiving objects: 68% (3794/5579) Receiving objects: 69% (3850/5579) Receiving objects: 70% (3906/5579) Receiving objects: 71% (3962/5579) Receiving objects: 72% (4017/5579) Receiving objects: 73% (4073/5579) Receiving objects: 74% (4129/5579) Receiving objects: 75% (4185/5579) Receiving objects: 76% (4241/5579) Receiving objects: 77% (4296/5579) Receiving objects: 78% (4352/5579) Receiving objects: 79% (4408/5579) Receiving objects: 80% (4464/5579) Receiving objects: 81% (4519/5579) Receiving objects: 82% (4575/5579) Receiving objects: 83% (4631/5579) Receiving objects: 84% (4687/5579) Receiving objects: 85% (4743/5579) Receiving objects: 86% (4798/5579) Receiving objects: 87% (4854/5579) Receiving objects: 88% (4910/5579) Receiving objects: 89% (4966/5579) Receiving objects: 90% (5022/5579) Receiving objects: 91% (5077/5579) Receiving objects: 92% (5133/5579) Receiving objects: 93% (5189/5579) Receiving objects: 94% (5245/5579) Receiving objects: 95% (5301/5579) Receiving objects: 96% (5356/5579) Receiving objects: 97% (5412/5579) Receiving objects: 98% (5468/5579) remote: Total 5579 (delta 1891), reused 1662 (delta 1662), pack-reused 3227
Receiving objects: 99% (5524/5579) Receiving objects: 100% (5579/5579) Receiving objects: 100% (5579/5579), 782.76 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/2048) Resolving deltas: 1% (28/2048) Resolving deltas: 2% (41/2048) Resolving deltas: 3% (66/2048) Resolving deltas: 4% (82/2048) Resolving deltas: 5% (103/2048) Resolving deltas: 6% (124/2048) Resolving deltas: 7% (144/2048) Resolving deltas: 8% (174/2048) Resolving deltas: 9% (192/2048) Resolving deltas: 10% (213/2048) Resolving deltas: 11% (226/2048) Resolving deltas: 17% (351/2048) Resolving deltas: 18% (372/2048) Resolving deltas: 19% (390/2048) Resolving deltas: 20% (414/2048) Resolving deltas: 21% (431/2048) Resolving deltas: 22% (452/2048) Resolving deltas: 23% (474/2048) Resolving deltas: 24% (493/2048) Resolving deltas: 25% (516/2048) Resolving deltas: 26% (543/2048) Resolving deltas: 27% (554/2048) Resolving deltas: 28% (576/2048) Resolving deltas: 29% (597/2048) Resolving deltas: 30% (617/2048) Resolving deltas: 31% (639/2048) Resolving deltas: 32% (665/2048) Resolving deltas: 33% (682/2048) Resolving deltas: 34% (709/2048) Resolving deltas: 35% (717/2048) Resolving deltas: 36% (746/2048) Resolving deltas: 37% (758/2048) Resolving deltas: 38% (782/2048) Resolving deltas: 39% (804/2048) Resolving deltas: 40% (829/2048) Resolving deltas: 41% (847/2048) Resolving deltas: 42% (863/2048) Resolving deltas: 43% (883/2048) Resolving deltas: 44% (908/2048) Resolving deltas: 45% (926/2048) Resolving deltas: 46% (943/2048) Resolving deltas: 47% (967/2048) Resolving deltas: 48% (986/2048) Resolving deltas: 49% (1013/2048) Resolving deltas: 50% (1031/2048) Resolving deltas: 51% (1048/2048) Resolving deltas: 52% (1067/2048) Resolving deltas: 53% (1086/2048) Resolving deltas: 54% (1106/2048) Resolving deltas: 55% (1129/2048) Resolving deltas: 56% (1149/2048) Resolving deltas: 57% (1171/2048) Resolving deltas: 58% (1188/2048) Resolving deltas: 59% (1209/2048) Resolving deltas: 60% (1231/2048) Resolving deltas: 61% (1250/2048) Resolving deltas: 62% (1270/2048) Resolving deltas: 63% (1292/2048) Resolving deltas: 64% (1312/2048) Resolving deltas: 65% (1340/2048) Resolving deltas: 66% (1352/2048) Resolving deltas: 67% (1373/2048) Resolving deltas: 68% (1396/2048) Resolving deltas: 69% (1415/2048) Resolving deltas: 70% (1436/2048) Resolving deltas: 71% (1456/2048) Resolving deltas: 72% (1475/2048) Resolving deltas: 73% (1497/2048) Resolving deltas: 74% (1516/2048) Resolving deltas: 75% (1536/2048) Resolving deltas: 76% (1557/2048) Resolving deltas: 77% (1587/2048) Resolving deltas: 78% (1598/2048) Resolving deltas: 79% (1619/2048) Resolving deltas: 80% (1639/2048) Resolving deltas: 81% (1660/2048) Resolving deltas: 82% (1689/2048) Resolving deltas: 83% (1701/2048) Resolving deltas: 84% (1722/2048) Resolving deltas: 85% (1742/2048) Resolving deltas: 86% (1762/2048) Resolving deltas: 87% (1782/2048) Resolving deltas: 88% (1803/2048) Resolving deltas: 89% (1824/2048) Resolving deltas: 90% (1844/2048) Resolving deltas: 91% (1864/2048) Resolving deltas: 92% (1886/2048) Resolving deltas: 93% (1910/2048) Resolving deltas: 94% (1926/2048) Resolving deltas: 95% (1946/2048) Resolving deltas: 96% (1969/2048) Resolving deltas: 97% (1988/2048) Resolving deltas: 98% (2008/2048) Resolving deltas: 99% (2028/2048) Resolving deltas: 100% (2048/2048) Resolving deltas: 100% (2048/2048), completed with 657 local objects.
4daac66..b2329a7 master -> origin/master
error: unable to resolve reference refs/remotes/origin/pr/1687/merge: No such file or directory
! 2015abe...19c09b1 refs/pull/1687/merge -> origin/pr/1687/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1725/merge: No such file or directory
! 41265ef...34ca686 refs/pull/1725/merge -> origin/pr/1725/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1729/merge: No such file or directory
! 3335bab...8554e02 refs/pull/1729/merge -> origin/pr/1729/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1851/merge: No such file or directory
! e0ed99c...77df100 refs/pull/1851/merge -> origin/pr/1851/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1898/merge: No such file or directory
! ce64239...91f1cc1 refs/pull/1898/merge -> origin/pr/1898/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 11a2c09...c50d1aa refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! 46b8c09...54e1d12 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! 559b5e1...7ba8ef3 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! 817e86b...bca64ae refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! 7bf8029...1f3d75a refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! 103c0ee...51430f7 refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 3243566...b3cddb5 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 61f99a7...9e270df refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 6de1e89...10e75d3 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 76ede54...7823062 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 6403375...745679b refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 13ec031...30358cc refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! c687718...25caa4e refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 9f61985...c2c61e1 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/head: No such file or directory
! ec66c98...e68a9d8 refs/pull/2415/head -> origin/pr/2415/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! ddb1eb9...b39699d refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! b11d06e...e2d37e8 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! b5e2998...e67e4ee refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! bbb87fd...6709514 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 11cc019...9f60c28 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2447/head: No such file or directory
! b37c9b3..093665a refs/pull/2447/head -> origin/pr/2447/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 8f1c300...6428fda refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! 1b02fd0...84ed5b5 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 74c2dbc...bfe9cd8 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 5dbcc2f...f9610fe refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 7d77352...00dc4b6 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! bd48535...d4e30ab refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! cac665b...650a5a5 refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/head: No such file or directory
! c050088...e5e6e63 refs/pull/2501/head -> origin/pr/2501/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! 8c9c850...b7b8c88 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/head: No such file or directory
! 530ef12..9d42c8f refs/pull/2506/head -> origin/pr/2506/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! 4b61e9a...8382c3d refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 9889dc1...76ca42f refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! bc80fc2...bbc031b refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! fd2fa2f...b3a60fb refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! 861da53...f45dc4c refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! cf4f460...ca83009 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b2329a7eff1e2b660af1efcc0a58bc54a478bfdd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b2329a7eff1e2b660af1efcc0a58bc54a478bfdd
> git rev-list 4daac664426da06268fa84a0a07793f818ce3913 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6233322227702473774.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1481912878223435571.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2446318397074000493.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson200514322324925540.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-14 18:02:48,869 ad738d49 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/ad738d49/pkb.log
2017-04-14 18:02:48,869 ad738d49 MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-14 18:02:48,870 ad738d49 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-14 18:02:48,963 ad738d49 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-14 18:02:49,055 ad738d49 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-14 18:02:49,057 ad738d49 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-14 18:02:49,058 ad738d49 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-14 18:02:49,063 ad738d49 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-14 18:02:49,065 ad738d49 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-14 18:02:49,086 ad738d49 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-14 18:02:49,087 ad738d49 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/ad738d49/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #307
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/307/display/redirect>
------------------------------------------
[...truncated 237.11 KB...]
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1644, done.
remote: Compressing objects: 2% (1/42) remote: Compressing objects: 4% (2/42) remote: Compressing objects: 7% (3/42) remote: Compressing objects: 9% (4/42) remote: Compressing objects: 11% (5/42) remote: Compressing objects: 14% (6/42) remote: Compressing objects: 16% (7/42) remote: Compressing objects: 19% (8/42) remote: Compressing objects: 21% (9/42) remote: Compressing objects: 23% (10/42) remote: Compressing objects: 26% (11/42) remote: Compressing objects: 28% (12/42) remote: Compressing objects: 30% (13/42) remote: Compressing objects: 33% (14/42) remote: Compressing objects: 35% (15/42) remote: Compressing objects: 38% (16/42) remote: Compressing objects: 40% (17/42) remote: Compressing objects: 42% (18/42) remote: Compressing objects: 45% (19/42) remote: Compressing objects: 47% (20/42) remote: Compressing objects: 50% (21/42) remote: Compressing objects: 52% (22/42) remote: Compressing objects: 54% (23/42) remote: Compressing objects: 57% (24/42) remote: Compressing objects: 59% (25/42) remote: Compressing objects: 61% (26/42) remote: Compressing objects: 64% (27/42) remote: Compressing objects: 66% (28/42) remote: Compressing objects: 69% (29/42) remote: Compressing objects: 71% (30/42) remote: Compressing objects: 73% (31/42) remote: Compressing objects: 76% (32/42) remote: Compressing objects: 78% (33/42) remote: Compressing objects: 80% (34/42) remote: Compressing objects: 83% (35/42) remote: Compressing objects: 85% (36/42) remote: Compressing objects: 88% (37/42) remote: Compressing objects: 90% (38/42) remote: Compressing objects: 92% (39/42) remote: Compressing objects: 95% (40/42) remote: Compressing objects: 97% (41/42) remote: Compressing objects: 100% (42/42) remote: Compressing objects: 100% (42/42), done.
Receiving objects: 0% (1/1644) Receiving objects: 1% (17/1644) Receiving objects: 2% (33/1644) Receiving objects: 3% (50/1644) Receiving objects: 4% (66/1644) Receiving objects: 5% (83/1644) Receiving objects: 6% (99/1644) Receiving objects: 7% (116/1644) Receiving objects: 8% (132/1644) Receiving objects: 9% (148/1644) Receiving objects: 10% (165/1644) Receiving objects: 11% (181/1644) Receiving objects: 12% (198/1644) Receiving objects: 13% (214/1644) Receiving objects: 14% (231/1644) Receiving objects: 15% (247/1644) Receiving objects: 16% (264/1644) Receiving objects: 17% (280/1644) Receiving objects: 18% (296/1644) Receiving objects: 19% (313/1644) Receiving objects: 20% (329/1644) Receiving objects: 21% (346/1644) Receiving objects: 22% (362/1644) Receiving objects: 23% (379/1644) Receiving objects: 24% (395/1644) Receiving objects: 25% (411/1644) Receiving objects: 26% (428/1644) Receiving objects: 27% (444/1644) Receiving objects: 28% (461/1644) Receiving objects: 29% (477/1644) Receiving objects: 30% (494/1644) Receiving objects: 31% (510/1644) Receiving objects: 32% (527/1644) Receiving objects: 33% (543/1644) Receiving objects: 34% (559/1644) Receiving objects: 35% (576/1644) Receiving objects: 36% (592/1644) Receiving objects: 37% (609/1644) Receiving objects: 38% (625/1644) Receiving objects: 39% (642/1644) Receiving objects: 40% (658/1644) Receiving objects: 41% (675/1644) Receiving objects: 42% (691/1644) Receiving objects: 43% (707/1644) Receiving objects: 44% (724/1644) Receiving objects: 45% (740/1644) Receiving objects: 46% (757/1644) Receiving objects: 47% (773/1644) Receiving objects: 48% (790/1644) Receiving objects: 49% (806/1644) Receiving objects: 50% (822/1644) Receiving objects: 51% (839/1644) Receiving objects: 52% (855/1644) Receiving objects: 53% (872/1644) Receiving objects: 54% (888/1644) Receiving objects: 55% (905/1644) Receiving objects: 56% (921/1644) Receiving objects: 57% (938/1644) Receiving objects: 58% (954/1644) Receiving objects: 59% (970/1644) Receiving objects: 60% (987/1644) Receiving objects: 61% (1003/1644) Receiving objects: 62% (1020/1644) Receiving objects: 63% (1036/1644) Receiving objects: 64% (1053/1644) Receiving objects: 65% (1069/1644) Receiving objects: 66% (1086/1644) Receiving objects: 67% (1102/1644) Receiving objects: 68% (1118/1644) Receiving objects: 69% (1135/1644) Receiving objects: 70% (1151/1644) Receiving objects: 71% (1168/1644) Receiving objects: 72% (1184/1644) Receiving objects: 73% (1201/1644) Receiving objects: 74% (1217/1644) Receiving objects: 75% (1233/1644) Receiving objects: 76% (1250/1644) Receiving objects: 77% (1266/1644) Receiving objects: 78% (1283/1644) Receiving objects: 79% (1299/1644) Receiving objects: 80% (1316/1644) Receiving objects: 81% (1332/1644) Receiving objects: 82% (1349/1644) Receiving objects: 83% (1365/1644) Receiving objects: 84% (1381/1644) Receiving objects: 85% (1398/1644) Receiving objects: 86% (1414/1644) Receiving objects: 87% (1431/1644) Receiving objects: 88% (1447/1644) Receiving objects: 89% (1464/1644) Receiving objects: 90% (1480/1644) Receiving objects: 91% (1497/1644) Receiving objects: 92% (1513/1644) Receiving objects: 93% (1529/1644) Receiving objects: 94% (1546/1644) Receiving objects: 95% (1562/1644) Receiving objects: 96% (1579/1644) Receiving objects: 97% (1595/1644) remote: Total 1644 (delta 648), reused 625 (delta 625), pack-reused 973
Receiving objects: 98% (1612/1644) Receiving objects: 99% (1628/1644) Receiving objects: 100% (1644/1644) Receiving objects: 100% (1644/1644), 178.75 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/669) Resolving deltas: 1% (7/669) Resolving deltas: 2% (14/669) Resolving deltas: 4% (27/669) Resolving deltas: 5% (34/669) Resolving deltas: 6% (44/669) Resolving deltas: 8% (55/669) Resolving deltas: 9% (66/669) Resolving deltas: 10% (70/669) Resolving deltas: 11% (74/669) Resolving deltas: 12% (81/669) Resolving deltas: 13% (87/669) Resolving deltas: 14% (94/669) Resolving deltas: 15% (103/669) Resolving deltas: 16% (108/669) Resolving deltas: 17% (114/669) Resolving deltas: 18% (121/669) Resolving deltas: 19% (128/669) Resolving deltas: 20% (135/669) Resolving deltas: 21% (144/669) Resolving deltas: 22% (148/669) Resolving deltas: 23% (155/669) Resolving deltas: 24% (161/669) Resolving deltas: 25% (169/669) Resolving deltas: 26% (174/669) Resolving deltas: 27% (182/669) Resolving deltas: 28% (188/669) Resolving deltas: 29% (195/669) Resolving deltas: 30% (201/669) Resolving deltas: 32% (216/669) Resolving deltas: 33% (223/669) Resolving deltas: 34% (229/669) Resolving deltas: 35% (236/669) Resolving deltas: 36% (243/669) Resolving deltas: 37% (250/669) Resolving deltas: 38% (257/669) Resolving deltas: 39% (263/669) Resolving deltas: 40% (271/669) Resolving deltas: 41% (275/669) Resolving deltas: 42% (281/669) Resolving deltas: 43% (292/669) Resolving deltas: 44% (295/669) Resolving deltas: 45% (304/669) Resolving deltas: 46% (309/669) Resolving deltas: 47% (315/669) Resolving deltas: 48% (323/669) Resolving deltas: 49% (329/669) Resolving deltas: 50% (337/669) Resolving deltas: 51% (342/669) Resolving deltas: 52% (348/669) Resolving deltas: 53% (358/669) Resolving deltas: 54% (362/669) Resolving deltas: 55% (368/669) Resolving deltas: 56% (375/669) Resolving deltas: 57% (382/669) Resolving deltas: 58% (389/669) Resolving deltas: 59% (395/669) Resolving deltas: 60% (403/669) Resolving deltas: 61% (409/669) Resolving deltas: 62% (416/669) Resolving deltas: 63% (423/669) Resolving deltas: 64% (429/669) Resolving deltas: 65% (437/669) Resolving deltas: 66% (443/669) Resolving deltas: 67% (449/669) Resolving deltas: 68% (455/669) Resolving deltas: 69% (463/669) Resolving deltas: 70% (469/669) Resolving deltas: 71% (475/669) Resolving deltas: 72% (483/669) Resolving deltas: 73% (489/669) Resolving deltas: 74% (496/669) Resolving deltas: 75% (502/669) Resolving deltas: 76% (510/669) Resolving deltas: 77% (516/669) Resolving deltas: 78% (523/669) Resolving deltas: 79% (530/669) Resolving deltas: 80% (536/669) Resolving deltas: 81% (542/669) Resolving deltas: 82% (550/669) Resolving deltas: 83% (556/669) Resolving deltas: 84% (562/669) Resolving deltas: 85% (569/669) Resolving deltas: 86% (577/669) Resolving deltas: 87% (583/669) Resolving deltas: 88% (589/669) Resolving deltas: 89% (596/669) Resolving deltas: 90% (603/669) Resolving deltas: 91% (609/669) Resolving deltas: 92% (622/669) Resolving deltas: 93% (624/669) Resolving deltas: 94% (629/669) Resolving deltas: 95% (638/669) Resolving deltas: 96% (643/669) Resolving deltas: 97% (649/669) Resolving deltas: 98% (656/669) Resolving deltas: 99% (663/669) Resolving deltas: 100% (669/669) Resolving deltas: 100% (669/669), completed with 326 local objects.
error: unable to resolve reference refs/remotes/origin/pr/1632/merge: No such file or directory
! 9601ddc...8939a82 refs/pull/1632/merge -> origin/pr/1632/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2117/merge: No such file or directory
! 63e51d2...d2fcfb2 refs/pull/2117/merge -> origin/pr/2117/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2167/merge: No such file or directory
! 3afa157...e5df450 refs/pull/2167/merge -> origin/pr/2167/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2239/merge: No such file or directory
! b26429c...9919809 refs/pull/2239/merge -> origin/pr/2239/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2312/merge: No such file or directory
! e94139f...3d22125 refs/pull/2312/merge -> origin/pr/2312/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2326/merge: No such file or directory
! 86d0009...aa6ce40 refs/pull/2326/merge -> origin/pr/2326/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2329/merge: No such file or directory
! fa2aa3b...57774c1 refs/pull/2329/merge -> origin/pr/2329/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 754d078...4d3e7cf refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/head: No such file or directory
! a69b46b...0035e6c refs/pull/2406/head -> origin/pr/2406/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 373ff7f...9f61985 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! e5c16ef...52eae97 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! b42c26f...0d0bb75 refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! aaa9667...d770a09 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! c20b9a6...3f65416 refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! b62e07f...2a0d598 refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 1229edd...6f01db6 refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 44217fd...658fc7a refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! b7373ee...b6c8397 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! 5a1ef91...8df0158 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 9bcff36...1f4c150 refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
* [new ref] refs/pull/2539/head -> origin/pr/2539/head
* [new ref] refs/pull/2539/merge -> origin/pr/2539/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4daac664426da06268fa84a0a07793f818ce3913 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4daac664426da06268fa84a0a07793f818ce3913
> git rev-list 4daac664426da06268fa84a0a07793f818ce3913 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5501953256838239165.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson870941049174941019.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6001211396158323315.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson189230272472657798.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-14 12:02:05,497 2ccbd7f6 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/2ccbd7f6/pkb.log
2017-04-14 12:02:05,497 2ccbd7f6 MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-14 12:02:05,498 2ccbd7f6 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-14 12:02:05,740 2ccbd7f6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-14 12:02:05,823 2ccbd7f6 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-14 12:02:05,825 2ccbd7f6 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-14 12:02:05,826 2ccbd7f6 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-14 12:02:05,831 2ccbd7f6 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-14 12:02:05,833 2ccbd7f6 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-14 12:02:05,859 2ccbd7f6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-14 12:02:05,860 2ccbd7f6 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/2ccbd7f6/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #306
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/306/display/redirect?page=changes>
Changes:
[altay] [BEAM-1964] Fix lint issues for linter upgrade
[altay] fix the simplest typo
[altay] Update java8 examples pom files to include maven-shade-plugin.
------------------------------------------
[...truncated 248.73 KB...]
Resolving deltas: 0% (0/1484) Resolving deltas: 1% (16/1484) Resolving deltas: 2% (30/1484) Resolving deltas: 3% (47/1484) Resolving deltas: 4% (67/1484) Resolving deltas: 5% (75/1484) Resolving deltas: 6% (90/1484) Resolving deltas: 7% (108/1484) Resolving deltas: 9% (135/1484) Resolving deltas: 13% (203/1484) Resolving deltas: 16% (248/1484) Resolving deltas: 17% (261/1484) Resolving deltas: 19% (285/1484) Resolving deltas: 20% (297/1484) Resolving deltas: 21% (312/1484) Resolving deltas: 22% (328/1484) Resolving deltas: 23% (343/1484) Resolving deltas: 24% (357/1484) Resolving deltas: 25% (371/1484) Resolving deltas: 26% (390/1484) Resolving deltas: 27% (401/1484) Resolving deltas: 28% (426/1484) Resolving deltas: 29% (444/1484) Resolving deltas: 30% (446/1484) Resolving deltas: 31% (461/1484) Resolving deltas: 32% (480/1484) Resolving deltas: 33% (501/1484) Resolving deltas: 34% (506/1484) Resolving deltas: 35% (520/1484) Resolving deltas: 36% (537/1484) Resolving deltas: 37% (551/1484) Resolving deltas: 38% (565/1484) Resolving deltas: 39% (579/1484) Resolving deltas: 40% (595/1484) Resolving deltas: 41% (612/1484) Resolving deltas: 42% (624/1484) Resolving deltas: 43% (639/1484) Resolving deltas: 44% (664/1484) Resolving deltas: 45% (677/1484) Resolving deltas: 46% (694/1484) Resolving deltas: 47% (702/1484) Resolving deltas: 48% (717/1484) Resolving deltas: 49% (731/1484) Resolving deltas: 50% (742/1484) Resolving deltas: 51% (757/1484) Resolving deltas: 52% (780/1484) Resolving deltas: 53% (792/1484) Resolving deltas: 54% (810/1484) Resolving deltas: 55% (817/1484) Resolving deltas: 56% (832/1484) Resolving deltas: 57% (846/1484) Resolving deltas: 58% (861/1484) Resolving deltas: 59% (876/1484) Resolving deltas: 60% (892/1484) Resolving deltas: 61% (907/1484) Resolving deltas: 62% (923/1484) Resolving deltas: 63% (935/1484) Resolving deltas: 64% (950/1484) Resolving deltas: 65% (965/1484) Resolving deltas: 66% (981/1484) Resolving deltas: 67% (995/1484) Resolving deltas: 68% (1010/1484) Resolving deltas: 69% (1024/1484) Resolving deltas: 70% (1039/1484) Resolving deltas: 71% (1054/1484) Resolving deltas: 72% (1069/1484) Resolving deltas: 73% (1090/1484) Resolving deltas: 74% (1100/1484) Resolving deltas: 75% (1113/1484) Resolving deltas: 76% (1128/1484) Resolving deltas: 77% (1143/1484) Resolving deltas: 78% (1159/1484) Resolving deltas: 79% (1175/1484) Resolving deltas: 80% (1189/1484) Resolving deltas: 81% (1206/1484) Resolving deltas: 82% (1224/1484) Resolving deltas: 83% (1234/1484) Resolving deltas: 84% (1248/1484) Resolving deltas: 85% (1263/1484) Resolving deltas: 86% (1277/1484) Resolving deltas: 87% (1292/1484) Resolving deltas: 88% (1306/1484) Resolving deltas: 89% (1322/1484) Resolving deltas: 90% (1336/1484) Resolving deltas: 91% (1351/1484) Resolving deltas: 92% (1367/1484) Resolving deltas: 93% (1381/1484) Resolving deltas: 94% (1395/1484) Resolving deltas: 95% (1410/1484) Resolving deltas: 96% (1425/1484) Resolving deltas: 97% (1440/1484) Resolving deltas: 98% (1455/1484) Resolving deltas: 99% (1470/1484) Resolving deltas: 100% (1484/1484) Resolving deltas: 100% (1484/1484), completed with 522 local objects.
3fb75d3..4daac66 master -> origin/master
error: unable to resolve reference refs/remotes/origin/pr/1687/merge: No such file or directory
! 6ee392f...2015abe refs/pull/1687/merge -> origin/pr/1687/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1725/merge: No such file or directory
! f3dc640...41265ef refs/pull/1725/merge -> origin/pr/1725/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1729/merge: No such file or directory
! 8afd986...3335bab refs/pull/1729/merge -> origin/pr/1729/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1851/merge: No such file or directory
! e3df4cd...e0ed99c refs/pull/1851/merge -> origin/pr/1851/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1898/merge: No such file or directory
! cb4974c...ce64239 refs/pull/1898/merge -> origin/pr/1898/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 4f67125...11a2c09 refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! 97ab054...46b8c09 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! ba0f299...559b5e1 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! ebaa3fc...817e86b refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! 363eff3...7bf8029 refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2255/merge: No such file or directory
! 758fa72...65f9c59 refs/pull/2255/merge -> origin/pr/2255/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! c0ceaef...103c0ee refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 8dcfc0c...3243566 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 475d1a3...61f99a7 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! ea1a1c1...6de1e89 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! a15b8bc...76ede54 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 2885312...6403375 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! fd7b79c...13ec031 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2350/merge: No such file or directory
! 4c4970e...2e27515 refs/pull/2350/merge -> origin/pr/2350/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! e659631...c687718 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! 0b9e094...c30ae40 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 01efd4d...373ff7f refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 57fedf9...aebc993 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 6f97586...772230a refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 9be1fc4...b11d06e refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! af0d020...b5e2998 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 08315f8...bbb87fd refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 7c181c3...11cc019 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 123b26a...1f9e3f0 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! c73f8d3...8f1c300 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! bd8b07b...1b02fd0 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! d0ebd40...74c2dbc refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 18340dd...5dbcc2f refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 0759a55...7d77352 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 0a65fc5...1820056 refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! 33b60a2...bf83e88 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! a608a0b...bd48535 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! 090ce4f...cac665b refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! bd5aa11...8c9c850 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! e41ddce...4b61e9a refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! ed025b6...9889dc1 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! e7a05ab...bc80fc2 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! fbfb12c...fd2fa2f refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! 00882e5...861da53 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
* [new ref] refs/pull/2535/head -> origin/pr/2535/head
* [new ref] refs/pull/2535/merge -> origin/pr/2535/merge
* [new ref] refs/pull/2536/head -> origin/pr/2536/head
* [new ref] refs/pull/2536/merge -> origin/pr/2536/merge
* [new ref] refs/pull/2537/head -> origin/pr/2537/head
* [new ref] refs/pull/2537/merge -> origin/pr/2537/merge
* [new ref] refs/pull/2538/head -> origin/pr/2538/head
* [new ref] refs/pull/2538/merge -> origin/pr/2538/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 799a2d2...cf4f460 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4daac664426da06268fa84a0a07793f818ce3913 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4daac664426da06268fa84a0a07793f818ce3913
> git rev-list 3fb75d3c22a7988ba9ab05af986aa3594bc7b7f8 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9141185549414477474.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8873518343541925115.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7562927529858110220.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3197819248922753774.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-14 06:02:15,548 258d4cff MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/258d4cff/pkb.log
2017-04-14 06:02:15,548 258d4cff MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-14 06:02:15,549 258d4cff MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-14 06:02:15,644 258d4cff MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-14 06:02:15,733 258d4cff MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-14 06:02:15,735 258d4cff MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-14 06:02:15,735 258d4cff MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-14 06:02:15,740 258d4cff MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-14 06:02:15,742 258d4cff MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-14 06:02:15,765 258d4cff MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-14 06:02:15,766 258d4cff MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/258d4cff/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #305
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/305/display/redirect?page=changes>
Changes:
[altay] Pin versions in tox script
[altay] Update user_score.py
[sourabhbajaj] [BEAM-1101, BEAM-1068] Remove service account name credential pipeline
[altay] Improve gcloud logging message
[altay] [BEAM-1708] Improve error message when GCP not installed
[dhalperi] Remove Triggers.java from SDK entirely
[dhalperi] Merge PR#2423: Add Kubernetes scripts for clusters for Performance and
------------------------------------------
[...truncated 257.47 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2289/merge: No such file or directory
! f2cd85f...65b38a8 refs/pull/2289/merge -> origin/pr/2289/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 08461a1...ea1a1c1 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 00175d7...a15b8bc refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 6829e8e...2885312 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! a88c6b1...fd7b79c refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2350/merge: No such file or directory
! c7799e0...4c4970e refs/pull/2350/merge -> origin/pr/2350/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 2f534a5...e659631 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 9bedccd...27660d8 refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! 3b11d5e...0b9e094 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 241ec60...0da4bb9 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 83f1610...01efd4d refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2407/merge: No such file or directory
! 62ddf5b...774b88a refs/pull/2407/merge -> origin/pr/2407/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! f06b0c8...57fedf9 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2411/merge: No such file or directory
! a96af72...c155a44 refs/pull/2411/merge -> origin/pr/2411/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2412/merge: No such file or directory
! 8d36b9c...4549102 refs/pull/2412/merge -> origin/pr/2412/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 49fd3ee...6f97586 refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! fad0cc2...9be1fc4 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 1f4bba2...af0d020 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 55ee39c...7da0ba1 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! af76f0b...08315f8 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! ccb8287...a471275 refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2441/merge: No such file or directory
! d341a1b...ce97533 refs/pull/2441/merge -> origin/pr/2441/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 8b033b5...7c181c3 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! c0618d2...123b26a refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 1625a1c...c73f8d3 refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! ba6b2d3...bd8b07b refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2461/merge: No such file or directory
! 6555c33...00efdeb refs/pull/2461/merge -> origin/pr/2461/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2465/merge: No such file or directory
! e5301bd...1209746 refs/pull/2465/merge -> origin/pr/2465/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2467/merge: No such file or directory
! 3a6875d...4c793da refs/pull/2467/merge -> origin/pr/2467/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 9364d32...d0ebd40 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 73f96ad...18340dd refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2477/merge: No such file or directory
! 2de0590...a5f1d39 refs/pull/2477/merge -> origin/pr/2477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! d9434ad...0759a55 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 9c47b5c...0a65fc5 refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! 46abcbb...b9663eb refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! 96ce1b5...33b60a2 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! 47d17e2...a608a0b refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! 9c11f1a...ee5fed4 refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 7824d0b...b42c26f refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! 9b1a760...aaa9667 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! 6092c2f...090ce4f refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! a32caf8...bd5aa11 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! feffeba...e41ddce refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 9ebb97d...ed025b6 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 2916983...e7a05ab refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 3592759...fbfb12c refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! b318838...00882e5 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2513/merge: No such file or directory
! dede701...2b0b540 refs/pull/2513/merge -> origin/pr/2513/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 6b345b9...9bcff36 refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
* [new ref] refs/pull/2524/head -> origin/pr/2524/head
* [new ref] refs/pull/2525/head -> origin/pr/2525/head
* [new ref] refs/pull/2525/merge -> origin/pr/2525/merge
* [new ref] refs/pull/2526/head -> origin/pr/2526/head
* [new ref] refs/pull/2527/head -> origin/pr/2527/head
* [new ref] refs/pull/2527/merge -> origin/pr/2527/merge
* [new ref] refs/pull/2528/head -> origin/pr/2528/head
* [new ref] refs/pull/2528/merge -> origin/pr/2528/merge
* [new ref] refs/pull/2529/head -> origin/pr/2529/head
* [new ref] refs/pull/2529/merge -> origin/pr/2529/merge
* [new ref] refs/pull/2530/head -> origin/pr/2530/head
* [new ref] refs/pull/2530/merge -> origin/pr/2530/merge
* [new ref] refs/pull/2531/head -> origin/pr/2531/head
* [new ref] refs/pull/2531/merge -> origin/pr/2531/merge
* [new ref] refs/pull/2532/head -> origin/pr/2532/head
* [new ref] refs/pull/2532/merge -> origin/pr/2532/merge
* [new ref] refs/pull/2533/head -> origin/pr/2533/head
* [new ref] refs/pull/2533/merge -> origin/pr/2533/merge
* [new ref] refs/pull/2534/head -> origin/pr/2534/head
* [new ref] refs/pull/2534/merge -> origin/pr/2534/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 7c50303...799a2d2 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3fb75d3c22a7988ba9ab05af986aa3594bc7b7f8 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3fb75d3c22a7988ba9ab05af986aa3594bc7b7f8
> git rev-list 2f400e2ac6e1375858d52ecd03af0993de13ad64 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3123439972056288140.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5676321341982371468.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2867923030602670394.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8703219437558408318.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-14 00:02:28,384 819e6a7b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/819e6a7b/pkb.log
2017-04-14 00:02:28,385 819e6a7b MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-14 00:02:28,385 819e6a7b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-14 00:02:28,637 819e6a7b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-14 00:02:28,721 819e6a7b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-14 00:02:28,723 819e6a7b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-14 00:02:28,723 819e6a7b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-14 00:02:28,729 819e6a7b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-14 00:02:28,731 819e6a7b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-14 00:02:28,755 819e6a7b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-14 00:02:28,755 819e6a7b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/819e6a7b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #304
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/304/display/redirect?page=changes>
Changes:
[lcwik] Test all Known Coders to ensure they Serialize via URN
[tgroh] Represent a Pipeline via a list of Top-level Transforms
[tgroh] Improve Empty Create Default Coder Error Message
------------------------------------------
[...truncated 239.50 KB...]
remote: Counting objects: 4174, done.
remote: Compressing objects: 0% (1/388) remote: Compressing objects: 1% (4/388) remote: Compressing objects: 2% (8/388) remote: Compressing objects: 3% (12/388) remote: Compressing objects: 4% (16/388) remote: Compressing objects: 5% (20/388) remote: Compressing objects: 6% (24/388) remote: Compressing objects: 7% (28/388) remote: Compressing objects: 8% (32/388) remote: Compressing objects: 9% (35/388) remote: Compressing objects: 10% (39/388) remote: Compressing objects: 11% (43/388) remote: Compressing objects: 12% (47/388) remote: Compressing objects: 13% (51/388) remote: Compressing objects: 14% (55/388) remote: Compressing objects: 15% (59/388) remote: Compressing objects: 16% (63/388) remote: Compressing objects: 17% (66/388) remote: Compressing objects: 18% (70/388) remote: Compressing objects: 19% (74/388) remote: Compressing objects: 20% (78/388) remote: Compressing objects: 21% (82/388) remote: Compressing objects: 22% (86/388) remote: Compressing objects: 23% (90/388) remote: Compressing objects: 24% (94/388) remote: Compressing objects: 25% (97/388) remote: Compressing objects: 26% (101/388) remote: Compressing objects: 27% (105/388) remote: Compressing objects: 28% (109/388) remote: Compressing objects: 29% (113/388) remote: Compressing objects: 30% (117/388) remote: Compressing objects: 31% (121/388) remote: Compressing objects: 32% (125/388) remote: Compressing objects: 33% (129/388) remote: Compressing objects: 34% (132/388) remote: Compressing objects: 35% (136/388) remote: Compressing objects: 36% (140/388) remote: Compressing objects: 37% (144/388) remote: Compressing objects: 38% (148/388) remote: Compressing objects: 39% (152/388) remote: Compressing objects: 40% (156/388) remote: Compressing objects: 41% (160/388) remote: Compressing objects: 42% (163/388) remote: Compressing objects: 43% (167/388) remote: Compressing objects: 44% (171/388) remote: Compressing objects: 45% (175/388) remote: Compressing objects: 46% (179/388) remote: Compressing objects: 47% (183/388) remote: Compressing objects: 48% (187/388) remote: Compressing objects: 49% (191/388) remote: Compressing objects: 50% (194/388) remote: Compressing objects: 51% (198/388) remote: Compressing objects: 52% (202/388) remote: Compressing objects: 53% (206/388) remote: Compressing objects: 54% (210/388) remote: Compressing objects: 55% (214/388) remote: Compressing objects: 56% (218/388) remote: Compressing objects: 57% (222/388) remote: Compressing objects: 58% (226/388) remote: Compressing objects: 59% (229/388) remote: Compressing objects: 60% (233/388) remote: Compressing objects: 61% (237/388) remote: Compressing objects: 62% (241/388) remote: Compressing objects: 63% (245/388) remote: Compressing objects: 64% (249/388) remote: Compressing objects: 65% (253/388) remote: Compressing objects: 66% (257/388) remote: Compressing objects: 67% (260/388) remote: Compressing objects: 68% (264/388) remote: Compressing objects: 69% (268/388) remote: Compressing objects: 70% (272/388) remote: Compressing objects: 71% (276/388) remote: Compressing objects: 72% (280/388) remote: Compressing objects: 73% (284/388) remote: Compressing objects: 74% (288/388) remote: Compressing objects: 75% (291/388) remote: Compressing objects: 76% (295/388) remote: Compressing objects: 77% (299/388) remote: Compressing objects: 78% (303/388) remote: Compressing objects: 79% (307/388) remote: Compressing objects: 80% (311/388) remote: Compressing objects: 81% (315/388) remote: Compressing objects: 82% (319/388) remote: Compressing objects: 83% (323/388) remote: Compressing objects: 84% (326/388) remote: Compressing objects: 85% (330/388) remote: Compressing objects: 86% (334/388) remote: Compressing objects: 87% (338/388) remote: Compressing objects: 88% (342/388) remote: Compressing objects: 89% (346/388) remote: Compressing objects: 90% (350/388) remote: Compressing objects: 91% (354/388) remote: Compressing objects: 92% (357/388) remote: Compressing objects: 93% (361/388) remote: Compressing objects: 94% (365/388) remote: Compressing objects: 95% (369/388) remote: Compressing objects: 96% (373/388) remote: Compressing objects: 97% (377/388) remote: Compressing objects: 98% (381/388) remote: Compressing objects: 99% (385/388) remote: Compressing objects: 100% (388/388) remote: Compressing objects: 100% (388/388), done.
Receiving objects: 0% (1/4174) Receiving objects: 1% (42/4174) Receiving objects: 2% (84/4174) Receiving objects: 3% (126/4174) Receiving objects: 4% (167/4174) Receiving objects: 5% (209/4174) Receiving objects: 6% (251/4174) Receiving objects: 7% (293/4174) Receiving objects: 8% (334/4174) Receiving objects: 9% (376/4174) Receiving objects: 10% (418/4174) Receiving objects: 11% (460/4174) Receiving objects: 12% (501/4174) Receiving objects: 13% (543/4174) Receiving objects: 14% (585/4174) Receiving objects: 15% (627/4174) Receiving objects: 16% (668/4174) Receiving objects: 17% (710/4174) Receiving objects: 18% (752/4174) Receiving objects: 19% (794/4174) Receiving objects: 20% (835/4174) Receiving objects: 21% (877/4174) Receiving objects: 22% (919/4174) Receiving objects: 23% (961/4174) Receiving objects: 24% (1002/4174) Receiving objects: 25% (1044/4174) Receiving objects: 26% (1086/4174) Receiving objects: 27% (1127/4174) Receiving objects: 28% (1169/4174) Receiving objects: 29% (1211/4174) Receiving objects: 30% (1253/4174) Receiving objects: 31% (1294/4174) Receiving objects: 32% (1336/4174) Receiving objects: 33% (1378/4174) Receiving objects: 34% (1420/4174) Receiving objects: 35% (1461/4174) Receiving objects: 36% (1503/4174) Receiving objects: 37% (1545/4174) Receiving objects: 38% (1587/4174) Receiving objects: 39% (1628/4174) Receiving objects: 40% (1670/4174) Receiving objects: 41% (1712/4174) Receiving objects: 42% (1754/4174) Receiving objects: 43% (1795/4174) Receiving objects: 44% (1837/4174) Receiving objects: 45% (1879/4174) Receiving objects: 46% (1921/4174) Receiving objects: 47% (1962/4174) Receiving objects: 48% (2004/4174) Receiving objects: 49% (2046/4174) Receiving objects: 50% (2087/4174) Receiving objects: 51% (2129/4174) Receiving objects: 52% (2171/4174) Receiving objects: 53% (2213/4174) Receiving objects: 54% (2254/4174) Receiving objects: 55% (2296/4174) Receiving objects: 56% (2338/4174) Receiving objects: 57% (2380/4174) Receiving objects: 58% (2421/4174) Receiving objects: 59% (2463/4174) Receiving objects: 60% (2505/4174) Receiving objects: 61% (2547/4174) Receiving objects: 62% (2588/4174) Receiving objects: 63% (2630/4174) Receiving objects: 64% (2672/4174) Receiving objects: 65% (2714/4174) Receiving objects: 66% (2755/4174) Receiving objects: 67% (2797/4174) Receiving objects: 68% (2839/4174) Receiving objects: 69% (2881/4174) Receiving objects: 70% (2922/4174) Receiving objects: 71% (2964/4174) Receiving objects: 72% (3006/4174) Receiving objects: 73% (3048/4174) Receiving objects: 74% (3089/4174) Receiving objects: 75% (3131/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 76% (3173/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 77% (3214/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 78% (3256/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 79% (3298/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 80% (3340/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 81% (3381/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 82% (3423/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 83% (3465/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 84% (3507/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 85% (3548/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 86% (3590/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 87% (3632/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 88% (3674/4174), 331.96 KiB | 637.00 KiB/s remote: Total 4174 (delta 1388), reused 1196 (delta 1196), pack-reused 2431
Receiving objects: 89% (3715/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 90% (3757/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 91% (3799/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 92% (3841/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 93% (3882/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 94% (3924/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 95% (3966/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 96% (4008/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 97% (4049/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 98% (4091/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 99% (4133/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 100% (4174/4174), 331.96 KiB | 637.00 KiB/s Receiving objects: 100% (4174/4174), 568.60 KiB | 637.00 KiB/s, done.
Resolving deltas: 0% (0/1505) Resolving deltas: 1% (19/1505) Resolving deltas: 2% (32/1505) Resolving deltas: 3% (46/1505) Resolving deltas: 4% (63/1505) Resolving deltas: 5% (81/1505) Resolving deltas: 6% (92/1505) Resolving deltas: 7% (107/1505) Resolving deltas: 8% (124/1505) Resolving deltas: 9% (143/1505) Resolving deltas: 12% (191/1505) Resolving deltas: 13% (198/1505) Resolving deltas: 15% (240/1505) Resolving deltas: 16% (253/1505) Resolving deltas: 18% (280/1505) Resolving deltas: 19% (288/1505) Resolving deltas: 20% (302/1505) Resolving deltas: 21% (327/1505) Resolving deltas: 22% (340/1505) Resolving deltas: 23% (358/1505) Resolving deltas: 24% (364/1505) Resolving deltas: 25% (378/1505) Resolving deltas: 26% (393/1505) Resolving deltas: 27% (410/1505) Resolving deltas: 28% (426/1505) Resolving deltas: 29% (441/1505) Resolving deltas: 30% (453/1505) Resolving deltas: 31% (469/1505) Resolving deltas: 32% (482/1505) Resolving deltas: 33% (501/1505) Resolving deltas: 34% (512/1505) Resolving deltas: 35% (528/1505) Resolving deltas: 36% (548/1505) Resolving deltas: 37% (563/1505) Resolving deltas: 39% (590/1505) Resolving deltas: 40% (608/1505) Resolving deltas: 41% (620/1505) Resolving deltas: 42% (634/1505) Resolving deltas: 43% (654/1505) Resolving deltas: 44% (664/1505) Resolving deltas: 45% (678/1505) Resolving deltas: 46% (694/1505) Resolving deltas: 47% (712/1505) Resolving deltas: 49% (740/1505) Resolving deltas: 50% (757/1505) Resolving deltas: 51% (768/1505) Resolving deltas: 52% (790/1505) Resolving deltas: 53% (804/1505) Resolving deltas: 54% (813/1505) Resolving deltas: 55% (829/1505) Resolving deltas: 56% (850/1505) Resolving deltas: 57% (858/1505) Resolving deltas: 58% (878/1505) Resolving deltas: 59% (888/1505) Resolving deltas: 60% (903/1505) Resolving deltas: 61% (919/1505) Resolving deltas: 62% (937/1505) Resolving deltas: 63% (949/1505) Resolving deltas: 64% (965/1505) Resolving deltas: 65% (980/1505) Resolving deltas: 66% (994/1505) Resolving deltas: 67% (1009/1505) Resolving deltas: 68% (1024/1505) Resolving deltas: 69% (1039/1505) Resolving deltas: 70% (1054/1505) Resolving deltas: 71% (1076/1505) Resolving deltas: 72% (1084/1505) Resolving deltas: 73% (1099/1505) Resolving deltas: 74% (1114/1505) Resolving deltas: 75% (1129/1505) Resolving deltas: 76% (1144/1505) Resolving deltas: 77% (1160/1505) Resolving deltas: 78% (1176/1505) Resolving deltas: 79% (1192/1505) Resolving deltas: 80% (1205/1505) Resolving deltas: 81% (1222/1505) Resolving deltas: 82% (1235/1505) Resolving deltas: 83% (1251/1505) Resolving deltas: 84% (1267/1505) Resolving deltas: 85% (1291/1505) Resolving deltas: 86% (1297/1505) Resolving deltas: 87% (1310/1505) Resolving deltas: 88% (1326/1505) Resolving deltas: 89% (1340/1505) Resolving deltas: 90% (1356/1505) Resolving deltas: 91% (1370/1505) Resolving deltas: 92% (1385/1505) Resolving deltas: 93% (1401/1505) Resolving deltas: 94% (1416/1505) Resolving deltas: 95% (1430/1505) Resolving deltas: 96% (1445/1505) Resolving deltas: 97% (1460/1505) Resolving deltas: 98% (1476/1505) Resolving deltas: 99% (1490/1505) Resolving deltas: 100% (1505/1505) Resolving deltas: 100% (1505/1505), completed with 529 local objects.
21a2b96..2f400e2 master -> origin/master
error: unable to resolve reference refs/remotes/origin/pr/1632/merge: No such file or directory
! 6443b71...9601ddc refs/pull/1632/merge -> origin/pr/1632/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1687/merge: No such file or directory
! 79b554b...bb1f7b1 refs/pull/1687/merge -> origin/pr/1687/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1725/merge: No such file or directory
! 32b0688...fa768f6 refs/pull/1725/merge -> origin/pr/1725/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1729/merge: No such file or directory
! f7d42fc...a1c35ff refs/pull/1729/merge -> origin/pr/1729/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1851/merge: No such file or directory
! 5ae11ca...e948acd refs/pull/1851/merge -> origin/pr/1851/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1898/merge: No such file or directory
! aa789ad...12d6897 refs/pull/1898/merge -> origin/pr/1898/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 06c9ea9...b3fc98c refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! 693c388...6232dd2 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2117/merge: No such file or directory
! 36e5d99...63e51d2 refs/pull/2117/merge -> origin/pr/2117/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! 2faf579...80566bf refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2167/merge: No such file or directory
! 2e6ccea...3afa157 refs/pull/2167/merge -> origin/pr/2167/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! 022ddfc...86b3f7d refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! b4fe6db...0af30a9 refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2239/merge: No such file or directory
! 6287975...b26429c refs/pull/2239/merge -> origin/pr/2239/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2242/merge: No such file or directory
! 93c7b85...be0f75a refs/pull/2242/merge -> origin/pr/2242/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2256/merge: No such file or directory
! 8eca896...f0c3182 refs/pull/2256/merge -> origin/pr/2256/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! f2dbc1d...c6a57dc refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 4cdcbec...b12a7a5 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! d2fedf2...2e4676e refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2305/merge: No such file or directory
! 34ec527...03cbf9b refs/pull/2305/merge -> origin/pr/2305/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2307/merge: No such file or directory
! 55c9ec6...662a8f2 refs/pull/2307/merge -> origin/pr/2307/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2310/merge: No such file or directory
! 91531bc...35d8095 refs/pull/2310/merge -> origin/pr/2310/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2315/merge: No such file or directory
! 67f684a...5e6087b refs/pull/2315/merge -> origin/pr/2315/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2323/merge: No such file or directory
! a24eec0...0698daa refs/pull/2323/merge -> origin/pr/2323/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 66f0342...08461a1 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! a2ada88...00175d7 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 24f7b87...6829e8e refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 15ba6f7...a88c6b1 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/merge: No such file or directory
! 2cc86f5...9c4a758 refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! bf31cf5...2f534a5 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! 4b7959a...a75f3b1 refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! e3e860b...356ed27 refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! e87a329...c43846c refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! bd76610...754d078 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 0106103...83f1610 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 272df41...fad0cc2 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 2b8decc...1f4bba2 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! 9e938d6...2341a96 refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 52c092d...55ee39c refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! e92fe53...af76f0b refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 263c128...8b033b5 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 1f805ec...1625a1c refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! aa94078...ba6b2d3 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! c9ac3b7...9364d32 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 2300f76...73f96ad refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 2df0127...d9434ad refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! 62fbb64...96ce1b5 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! ff75934...47d17e2 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! b49cc6c...6092c2f refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! b73aceb...a32caf8 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 9757aa5...1229edd refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! a484ab3...feffeba refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! d2990c2...9ebb97d refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 42f0cd3...2916983 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! f3100dd...3592759 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! 9c70d19...b318838 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! af6195b...7c50303 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2f400e2ac6e1375858d52ecd03af0993de13ad64 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2f400e2ac6e1375858d52ecd03af0993de13ad64
> git rev-list 21a2b96a1f617870aa5926d69878a72533ba259e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5911995645257953347.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6765133476494680153.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2264567051105139606.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5843306024050290123.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-13 18:02:48,121 6149143a MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/6149143a/pkb.log
2017-04-13 18:02:48,121 6149143a MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-13 18:02:48,121 6149143a MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-13 18:02:48,772 6149143a MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-13 18:02:48,894 6149143a MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-13 18:02:48,897 6149143a MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-13 18:02:48,897 6149143a MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-13 18:02:48,902 6149143a MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-13 18:02:48,904 6149143a MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-13 18:02:48,930 6149143a MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-13 18:02:48,931 6149143a MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/6149143a/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #303
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/303/display/redirect>
------------------------------------------
[...truncated 238.28 KB...]
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1363, done.
remote: Compressing objects: 0% (1/380) remote: Compressing objects: 1% (4/380) remote: Compressing objects: 2% (8/380) remote: Compressing objects: 3% (12/380) remote: Compressing objects: 4% (16/380) remote: Compressing objects: 5% (19/380) remote: Compressing objects: 6% (23/380) remote: Compressing objects: 7% (27/380) remote: Compressing objects: 8% (31/380) remote: Compressing objects: 9% (35/380) remote: Compressing objects: 10% (38/380) remote: Compressing objects: 11% (42/380) remote: Compressing objects: 12% (46/380) remote: Compressing objects: 13% (50/380) remote: Compressing objects: 14% (54/380) remote: Compressing objects: 15% (57/380) remote: Compressing objects: 16% (61/380) remote: Compressing objects: 17% (65/380) remote: Compressing objects: 18% (69/380) remote: Compressing objects: 19% (73/380) remote: Compressing objects: 20% (76/380) remote: Compressing objects: 21% (80/380) remote: Compressing objects: 22% (84/380) remote: Compressing objects: 23% (88/380) remote: Compressing objects: 24% (92/380) remote: Compressing objects: 25% (95/380) remote: Compressing objects: 26% (99/380) remote: Compressing objects: 27% (103/380) remote: Compressing objects: 28% (107/380) remote: Compressing objects: 29% (111/380) remote: Compressing objects: 30% (114/380) remote: Compressing objects: 31% (118/380) remote: Compressing objects: 32% (122/380) remote: Compressing objects: 33% (126/380) remote: Compressing objects: 34% (130/380) remote: Compressing objects: 35% (133/380) remote: Compressing objects: 36% (137/380) remote: Compressing objects: 37% (141/380) remote: Compressing objects: 38% (145/380) remote: Compressing objects: 39% (149/380) remote: Compressing objects: 40% (152/380) remote: Compressing objects: 41% (156/380) remote: Compressing objects: 42% (160/380) remote: Compressing objects: 43% (164/380) remote: Compressing objects: 44% (168/380) remote: Compressing objects: 45% (171/380) remote: Compressing objects: 46% (175/380) remote: Compressing objects: 47% (179/380) remote: Compressing objects: 48% (183/380) remote: Compressing objects: 49% (187/380) remote: Compressing objects: 50% (190/380) remote: Compressing objects: 51% (194/380) remote: Compressing objects: 52% (198/380) remote: Compressing objects: 53% (202/380) remote: Compressing objects: 54% (206/380) remote: Compressing objects: 55% (209/380) remote: Compressing objects: 56% (213/380) remote: Compressing objects: 57% (217/380) remote: Compressing objects: 58% (221/380) remote: Compressing objects: 59% (225/380) remote: Compressing objects: 60% (228/380) remote: Compressing objects: 61% (232/380) remote: Compressing objects: 62% (236/380) remote: Compressing objects: 63% (240/380) remote: Compressing objects: 64% (244/380) remote: Compressing objects: 65% (247/380) remote: Compressing objects: 66% (251/380) remote: Compressing objects: 67% (255/380) remote: Compressing objects: 68% (259/380) remote: Compressing objects: 69% (263/380) remote: Compressing objects: 70% (266/380) remote: Compressing objects: 71% (270/380) remote: Compressing objects: 72% (274/380) remote: Compressing objects: 73% (278/380) remote: Compressing objects: 74% (282/380) remote: Compressing objects: 75% (285/380) remote: Compressing objects: 76% (289/380) remote: Compressing objects: 77% (293/380) remote: Compressing objects: 78% (297/380) remote: Compressing objects: 79% (301/380) remote: Compressing objects: 80% (304/380) remote: Compressing objects: 81% (308/380) remote: Compressing objects: 82% (312/380) remote: Compressing objects: 83% (316/380) remote: Compressing objects: 84% (320/380) remote: Compressing objects: 85% (323/380) remote: Compressing objects: 86% (327/380) remote: Compressing objects: 87% (331/380) remote: Compressing objects: 88% (335/380) remote: Compressing objects: 89% (339/380) remote: Compressing objects: 90% (342/380) remote: Compressing objects: 91% (346/380) remote: Compressing objects: 92% (350/380) remote: Compressing objects: 93% (354/380) remote: Compressing objects: 94% (358/380) remote: Compressing objects: 95% (361/380) remote: Compressing objects: 96% (365/380) remote: Compressing objects: 97% (369/380) remote: Compressing objects: 98% (373/380) remote: Compressing objects: 99% (377/380) remote: Compressing objects: 100% (380/380) remote: Compressing objects: 100% (380/380), done.
Receiving objects: 0% (1/1363) Receiving objects: 1% (14/1363) Receiving objects: 2% (28/1363) Receiving objects: 3% (41/1363) Receiving objects: 4% (55/1363) Receiving objects: 5% (69/1363) Receiving objects: 6% (82/1363) Receiving objects: 7% (96/1363) Receiving objects: 8% (110/1363) Receiving objects: 9% (123/1363) Receiving objects: 10% (137/1363) Receiving objects: 11% (150/1363) Receiving objects: 12% (164/1363) Receiving objects: 13% (178/1363) Receiving objects: 14% (191/1363) Receiving objects: 15% (205/1363) Receiving objects: 16% (219/1363) Receiving objects: 17% (232/1363) Receiving objects: 18% (246/1363) Receiving objects: 19% (259/1363) Receiving objects: 20% (273/1363) Receiving objects: 21% (287/1363) Receiving objects: 22% (300/1363) Receiving objects: 23% (314/1363) Receiving objects: 24% (328/1363) Receiving objects: 25% (341/1363) Receiving objects: 26% (355/1363) Receiving objects: 27% (369/1363) Receiving objects: 28% (382/1363) Receiving objects: 29% (396/1363) Receiving objects: 30% (409/1363) Receiving objects: 31% (423/1363) Receiving objects: 32% (437/1363) Receiving objects: 33% (450/1363) Receiving objects: 34% (464/1363) Receiving objects: 35% (478/1363) Receiving objects: 36% (491/1363) Receiving objects: 37% (505/1363) Receiving objects: 38% (518/1363) Receiving objects: 39% (532/1363) Receiving objects: 40% (546/1363) Receiving objects: 41% (559/1363) Receiving objects: 42% (573/1363) Receiving objects: 43% (587/1363) Receiving objects: 44% (600/1363) Receiving objects: 45% (614/1363) Receiving objects: 46% (627/1363) Receiving objects: 47% (641/1363) Receiving objects: 48% (655/1363) Receiving objects: 49% (668/1363) Receiving objects: 50% (682/1363) Receiving objects: 51% (696/1363) Receiving objects: 52% (709/1363) Receiving objects: 53% (723/1363) Receiving objects: 54% (737/1363) Receiving objects: 55% (750/1363) Receiving objects: 56% (764/1363) Receiving objects: 57% (777/1363) Receiving objects: 58% (791/1363) Receiving objects: 59% (805/1363) Receiving objects: 60% (818/1363) Receiving objects: 61% (832/1363) Receiving objects: 62% (846/1363) Receiving objects: 63% (859/1363) Receiving objects: 64% (873/1363) Receiving objects: 65% (886/1363) Receiving objects: 66% (900/1363) Receiving objects: 67% (914/1363) Receiving objects: 68% (927/1363) Receiving objects: 69% (941/1363) Receiving objects: 70% (955/1363) Receiving objects: 71% (968/1363) Receiving objects: 72% (982/1363) Receiving objects: 73% (995/1363) Receiving objects: 74% (1009/1363) Receiving objects: 75% (1023/1363) Receiving objects: 76% (1036/1363) Receiving objects: 77% (1050/1363) remote: Total 1363 (delta 412), reused 296 (delta 296), pack-reused 362
Receiving objects: 78% (1064/1363) Receiving objects: 79% (1077/1363) Receiving objects: 80% (1091/1363) Receiving objects: 81% (1105/1363) Receiving objects: 82% (1118/1363) Receiving objects: 83% (1132/1363) Receiving objects: 84% (1145/1363) Receiving objects: 85% (1159/1363) Receiving objects: 86% (1173/1363) Receiving objects: 87% (1186/1363) Receiving objects: 88% (1200/1363) Receiving objects: 89% (1214/1363) Receiving objects: 90% (1227/1363) Receiving objects: 91% (1241/1363) Receiving objects: 92% (1254/1363) Receiving objects: 93% (1268/1363) Receiving objects: 94% (1282/1363) Receiving objects: 95% (1295/1363) Receiving objects: 96% (1309/1363) Receiving objects: 97% (1323/1363) Receiving objects: 98% (1336/1363) Receiving objects: 99% (1350/1363) Receiving objects: 100% (1363/1363) Receiving objects: 100% (1363/1363), 438.77 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/419) Resolving deltas: 1% (5/419) Resolving deltas: 3% (15/419) Resolving deltas: 6% (28/419) Resolving deltas: 8% (34/419) Resolving deltas: 9% (40/419) Resolving deltas: 11% (49/419) Resolving deltas: 13% (56/419) Resolving deltas: 14% (59/419) Resolving deltas: 18% (76/419) Resolving deltas: 19% (82/419) Resolving deltas: 20% (85/419) Resolving deltas: 22% (94/419) Resolving deltas: 23% (97/419) Resolving deltas: 24% (101/419) Resolving deltas: 25% (105/419) Resolving deltas: 26% (110/419) Resolving deltas: 27% (116/419) Resolving deltas: 28% (118/419) Resolving deltas: 29% (125/419) Resolving deltas: 30% (126/419) Resolving deltas: 31% (130/419) Resolving deltas: 32% (135/419) Resolving deltas: 34% (144/419) Resolving deltas: 36% (152/419) Resolving deltas: 37% (158/419) Resolving deltas: 38% (160/419) Resolving deltas: 39% (164/419) Resolving deltas: 40% (168/419) Resolving deltas: 41% (172/419) Resolving deltas: 42% (177/419) Resolving deltas: 43% (181/419) Resolving deltas: 44% (185/419) Resolving deltas: 45% (189/419) Resolving deltas: 46% (194/419) Resolving deltas: 47% (197/419) Resolving deltas: 48% (202/419) Resolving deltas: 49% (207/419) Resolving deltas: 50% (210/419) Resolving deltas: 51% (214/419) Resolving deltas: 52% (218/419) Resolving deltas: 53% (223/419) Resolving deltas: 54% (228/419) Resolving deltas: 55% (233/419) Resolving deltas: 59% (249/419) Resolving deltas: 60% (254/419) Resolving deltas: 61% (257/419) Resolving deltas: 62% (260/419) Resolving deltas: 63% (264/419) Resolving deltas: 64% (269/419) Resolving deltas: 65% (274/419) Resolving deltas: 66% (277/419) Resolving deltas: 67% (282/419) Resolving deltas: 68% (286/419) Resolving deltas: 69% (291/419) Resolving deltas: 70% (294/419) Resolving deltas: 71% (298/419) Resolving deltas: 72% (303/419) Resolving deltas: 73% (307/419) Resolving deltas: 74% (312/419) Resolving deltas: 75% (315/419) Resolving deltas: 76% (319/419) Resolving deltas: 77% (323/419) Resolving deltas: 78% (327/419) Resolving deltas: 79% (332/419) Resolving deltas: 80% (336/419) Resolving deltas: 81% (341/419) Resolving deltas: 82% (346/419) Resolving deltas: 83% (348/419) Resolving deltas: 84% (353/419) Resolving deltas: 85% (357/419) Resolving deltas: 86% (361/419) Resolving deltas: 87% (365/419) Resolving deltas: 88% (369/419) Resolving deltas: 89% (373/419) Resolving deltas: 90% (378/419) Resolving deltas: 91% (382/419) Resolving deltas: 92% (386/419) Resolving deltas: 93% (390/419) Resolving deltas: 94% (394/419) Resolving deltas: 95% (399/419) Resolving deltas: 96% (404/419) Resolving deltas: 97% (407/419) Resolving deltas: 98% (412/419) Resolving deltas: 99% (415/419) Resolving deltas: 100% (419/419) Resolving deltas: 100% (419/419), completed with 177 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2312/merge: No such file or directory
! 1291190...e94139f refs/pull/2312/merge -> origin/pr/2312/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2326/merge: No such file or directory
! 610eaa2...86d0009 refs/pull/2326/merge -> origin/pr/2326/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2329/merge: No such file or directory
! 20bbf13...fa2aa3b refs/pull/2329/merge -> origin/pr/2329/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/head: No such file or directory
! b4ce660...447fcc4 refs/pull/2401/head -> origin/pr/2401/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 1452f9c...bd76610 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! 921d0d1...ccb8287 refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! 64e410f...19fe331 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! 3b3df77...edf10d8 refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 2036ad8...e410b62 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! fca83db...21442f4 refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2437/merge: No such file or directory
! 7b0eafc...53d38b6 refs/pull/2437/merge -> origin/pr/2437/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! 9dd01c0...3d9e766 refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! bb0ba54...f7cf9e0 refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2441/merge: No such file or directory
! 3b60b91...d341a1b refs/pull/2441/merge -> origin/pr/2441/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2444/merge: No such file or directory
! b597f15...0fa0ac3 refs/pull/2444/merge -> origin/pr/2444/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2446/merge: No such file or directory
! 726d395...d8e68e0 refs/pull/2446/merge -> origin/pr/2446/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! 812ab1b...dd3a255 refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2451/merge: No such file or directory
! 04ed807...2556b0c refs/pull/2451/merge -> origin/pr/2451/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 770fdf9...13271e4 refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2454/merge: No such file or directory
! 5070afd...ebc1fcb refs/pull/2454/merge -> origin/pr/2454/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 3eb6981...c0618d2 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2461/merge: No such file or directory
! a469025...6555c33 refs/pull/2461/merge -> origin/pr/2461/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2463/merge: No such file or directory
! b5859a0...d8e1697 refs/pull/2463/merge -> origin/pr/2463/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2464/merge: No such file or directory
! d925561...e9ece7e refs/pull/2464/merge -> origin/pr/2464/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2465/merge: No such file or directory
! a95f45f...e5301bd refs/pull/2465/merge -> origin/pr/2465/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2466/merge: No such file or directory
! 64c1789...ecbddae refs/pull/2466/merge -> origin/pr/2466/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2467/merge: No such file or directory
! f59cdb3...3a6875d refs/pull/2467/merge -> origin/pr/2467/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2472/merge: No such file or directory
! c878ae3...831b2ca refs/pull/2472/merge -> origin/pr/2472/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! 24521dd...178a986 refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2475/merge: No such file or directory
! d2e8f53...fd356cf refs/pull/2475/merge -> origin/pr/2475/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2477/merge: No such file or directory
! 0e438cb...2de0590 refs/pull/2477/merge -> origin/pr/2477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2480/merge: No such file or directory
! d77124c...25129aa refs/pull/2480/merge -> origin/pr/2480/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 3093a87...9c47b5c refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! 09c1616...46abcbb refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! 53d4db7...9c11f1a refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2490/merge: No such file or directory
! 88d7cb3...3105f5b refs/pull/2490/merge -> origin/pr/2490/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2492/merge: No such file or directory
! a5842c1...25853db refs/pull/2492/merge -> origin/pr/2492/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! ed1bdd7...e5c16ef refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 53d45f9...7824d0b refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! a918d52...9b1a760 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! b83f68f...c20b9a6 refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 30f3087...b62e07f refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 6d5cee9...44217fd refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! 80646ec...b7373ee refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2513/merge: No such file or directory
! ac43e77...dede701 refs/pull/2513/merge -> origin/pr/2513/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! 0f55903...6b345b9 refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
* [new ref] refs/pull/2523/head -> origin/pr/2523/head
* [new ref] refs/pull/2523/merge -> origin/pr/2523/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 21a2b96a1f617870aa5926d69878a72533ba259e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 21a2b96a1f617870aa5926d69878a72533ba259e
> git rev-list 21a2b96a1f617870aa5926d69878a72533ba259e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5628607114048440720.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3864351552237230459.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2261432327707514885.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8328633429678672246.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-13 12:02:40,924 3cd68526 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3cd68526/pkb.log
2017-04-13 12:02:40,924 3cd68526 MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-13 12:02:40,925 3cd68526 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-13 12:02:41,290 3cd68526 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-13 12:02:41,376 3cd68526 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-13 12:02:41,378 3cd68526 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-13 12:02:41,378 3cd68526 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-13 12:02:41,384 3cd68526 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-13 12:02:41,386 3cd68526 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-13 12:02:41,409 3cd68526 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-13 12:02:41,409 3cd68526 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3cd68526/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #302
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/302/display/redirect?page=changes>
Changes:
[aviemzur] [BEAM-1950] Add missing 'static' keyword to
------------------------------------------
[...truncated 254.45 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 20d7d5b...06c9ea9 refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! fd98fa0...693c388 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2143/merge: No such file or directory
! 78aa347...4684695 refs/pull/2143/merge -> origin/pr/2143/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2146/merge: No such file or directory
! 4223a37...db88f4f refs/pull/2146/merge -> origin/pr/2146/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! 6745140...2faf579 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! f927ea9...022ddfc refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! 9242e99...b4fe6db refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! f33b9d1...f2dbc1d refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 0ad27c9...4cdcbec refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2275/merge: No such file or directory
! bf81970...b4a9a27 refs/pull/2275/merge -> origin/pr/2275/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 382d2d8...d2fedf2 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2289/merge: No such file or directory
! dfcd0a6...f2cd85f refs/pull/2289/merge -> origin/pr/2289/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2294/merge: No such file or directory
! a81bc0a...316c95d refs/pull/2294/merge -> origin/pr/2294/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 22e4ca8...66f0342 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 1ca2d90...a2ada88 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! cc88fa4...24f7b87 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! f43369f...15ba6f7 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2351/merge: No such file or directory
! 1258b0e...c052529 refs/pull/2351/merge -> origin/pr/2351/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 4d6ae2a...bf31cf5 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2375/merge: No such file or directory
! 2ec3dd2...6b2cff9 refs/pull/2375/merge -> origin/pr/2375/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 042f3f8...241ec60 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 4ef3b41...1452f9c refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 739b410...0106103 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 8c5865c...272df41 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! a9b1918...2b8decc refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 350c2b7...e92fe53 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2437/merge: No such file or directory
! 27bfed9...7b0eafc refs/pull/2437/merge -> origin/pr/2437/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! aa9935a...263c128 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2446/merge: No such file or directory
! b652cd5...726d395 refs/pull/2446/merge -> origin/pr/2446/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 393fdff...3eb6981 refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 3f0a55f...1f805ec refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! f1aef15...aa94078 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2461/merge: No such file or directory
! 8297c69...a469025 refs/pull/2461/merge -> origin/pr/2461/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! a9628c6...c9ac3b7 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 2fe1399...2300f76 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2480/merge: No such file or directory
! 8b5772f...d77124c refs/pull/2480/merge -> origin/pr/2480/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 70794be...2df0127 refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! d97be9c...3093a87 refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! 1befd55...09c1616 refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! 646ddc5...62fbb64 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! 34ce32c...ff75934 refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! 9050714...53d4db7 refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2490/merge: No such file or directory
! 217999c...88d7cb3 refs/pull/2490/merge -> origin/pr/2490/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! 0915262...ed1bdd7 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! b55a0cb...53d45f9 refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! c93e7fe...a918d52 refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! f663556...b49cc6c refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! a766154...b73aceb refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 5555365...30f3087 refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! e5eacbe...9757aa5 refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! 5a729dd...a484ab3 refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! a0fbd64...d2990c2 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! b7b5933...42f0cd3 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! fa95fd3...f3100dd refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! 3b15fe0...6d5cee9 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! 5800ae6...80646ec refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! dce5a00...9c70d19 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! ee00648...5a1ef91 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! a17eded...0f55903 refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
* [new ref] refs/pull/2519/head -> origin/pr/2519/head
* [new ref] refs/pull/2519/merge -> origin/pr/2519/merge
* [new ref] refs/pull/2520/head -> origin/pr/2520/head
* [new ref] refs/pull/2520/merge -> origin/pr/2520/merge
* [new ref] refs/pull/2521/head -> origin/pr/2521/head
* [new ref] refs/pull/2521/merge -> origin/pr/2521/merge
* [new ref] refs/pull/2522/head -> origin/pr/2522/head
* [new ref] refs/pull/2522/merge -> origin/pr/2522/merge
error: unable to resolve reference refs/remotes/origin/pr/284/merge: No such file or directory
! 7cec9f3...5d30780 refs/pull/284/merge -> origin/pr/284/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 0121978...af6195b refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 21a2b96a1f617870aa5926d69878a72533ba259e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 21a2b96a1f617870aa5926d69878a72533ba259e
> git rev-list dc672f42083c375872d87030523545866cea4f55 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson256315355149481464.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5948459804827245964.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4415092307348827806.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2463206724745091241.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-13 06:02:09,916 f84b94da MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/f84b94da/pkb.log
2017-04-13 06:02:09,917 f84b94da MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-13 06:02:09,917 f84b94da MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-13 06:02:10,099 f84b94da MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-13 06:02:10,182 f84b94da MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-13 06:02:10,185 f84b94da MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-13 06:02:10,185 f84b94da MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-13 06:02:10,190 f84b94da MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-13 06:02:10,192 f84b94da MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-13 06:02:10,217 f84b94da MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-13 06:02:10,217 f84b94da MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/f84b94da/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #301
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/301/display/redirect?page=changes>
Changes:
[jbonofre] [BEAM-1882] Update postgres k8 scripts & add scripts for running local
[kirpichov] Removes MapElements.MissingOutputTypeDescriptor
[kirpichov] Removes FlatMapElements.MissingOutputTypeDescriptor
[altay] Revert "Throw specialized exception in value providers"
[altay] Revert "Revert "Revert "Add ValueProvider class for FileBasedSource I/O
[jbonofre] [BEAM-911] Mark IO APIs as @Experimental
[tgroh] Move travis/jenkins folders in a test-infra folder
[tgroh] Move jdbc's postgres k8s scripts into shared k8s dir
[tgroh] Move HIFIO k8s scripts into shared dir
[chamikara] [BEAM-1222] Chunk size should be FS dependent
[dhalperi] Move Triggers from sdk-core to runners-core-construction
------------------------------------------
[...truncated 259.95 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2363/head: No such file or directory
! 3e3557b...831b11f refs/pull/2363/head -> origin/pr/2363/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! 5c504b9...4b7959a refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! fc1ce54...e3e860b refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! bb3a0bf...e87a329 refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 2bf744d...4ef3b41 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 6f0fe1f...739b410 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2407/merge: No such file or directory
! 928d4e7...62ddf5b refs/pull/2407/merge -> origin/pr/2407/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2412/merge: No such file or directory
! 4e09b85...8d36b9c refs/pull/2412/merge -> origin/pr/2412/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! b3f7127...ddb1eb9 refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 3b173fd...8c5865c refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2418/merge: No such file or directory
! bef3e4e...d2b960f refs/pull/2418/merge -> origin/pr/2418/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! d053379...a9b1918 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 6baf9d9...52c092d refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 363e746...350c2b7 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! c6e1cd4...921d0d1 refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! d82087d...64e410f refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 031eb80...cabd191 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! dea7fc9...2036ad8 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2436/merge: No such file or directory
! cd67231...fca83db refs/pull/2436/merge -> origin/pr/2436/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2439/merge: No such file or directory
! f769f23...9dd01c0 refs/pull/2439/merge -> origin/pr/2439/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2440/merge: No such file or directory
! 1071e10...bb0ba54 refs/pull/2440/merge -> origin/pr/2440/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! a581a04...aa9935a refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! 7709d38...812ab1b refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! 34949af...770fdf9 refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 205d344...3f0a55f refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! 0a93f40...f1aef15 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2463/merge: No such file or directory
! 0d28f97...b5859a0 refs/pull/2463/merge -> origin/pr/2463/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2465/merge: No such file or directory
! da67e19...a95f45f refs/pull/2465/merge -> origin/pr/2465/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2466/head: No such file or directory
! d098fbf...ad8ee8b refs/pull/2466/head -> origin/pr/2466/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2466/merge: No such file or directory
! e39cf48...64c1789 refs/pull/2466/merge -> origin/pr/2466/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 74ce4fe...a9628c6 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2475/merge: No such file or directory
! 4932314...d2e8f53 refs/pull/2475/merge -> origin/pr/2475/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2476/merge: No such file or directory
! 5820b39...2fe1399 refs/pull/2476/merge -> origin/pr/2476/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2477/merge: No such file or directory
! cd45d9c...0e438cb refs/pull/2477/merge -> origin/pr/2477/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2479/merge: No such file or directory
! 7cd8458...b74b79c refs/pull/2479/merge -> origin/pr/2479/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2480/merge: No such file or directory
! da4061b...8b5772f refs/pull/2480/merge -> origin/pr/2480/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2482/merge: No such file or directory
! 141c777...70794be refs/pull/2482/merge -> origin/pr/2482/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2483/merge: No such file or directory
! 77eb628...d97be9c refs/pull/2483/merge -> origin/pr/2483/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2484/merge: No such file or directory
! 8ae2784...1befd55 refs/pull/2484/merge -> origin/pr/2484/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2485/merge: No such file or directory
! c6087e0...646ddc5 refs/pull/2485/merge -> origin/pr/2485/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2488/merge: No such file or directory
! a3748bb...34ce32c refs/pull/2488/merge -> origin/pr/2488/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2489/merge: No such file or directory
! c241c76...9050714 refs/pull/2489/merge -> origin/pr/2489/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2490/merge: No such file or directory
! 0991abb...217999c refs/pull/2490/merge -> origin/pr/2490/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2492/merge: No such file or directory
! 7dc5d6b...a5842c1 refs/pull/2492/merge -> origin/pr/2492/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2493/merge: No such file or directory
! e4e972f...0915262 refs/pull/2493/merge -> origin/pr/2493/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2497/merge: No such file or directory
! 9ec2288...b55a0cb refs/pull/2497/merge -> origin/pr/2497/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2498/merge: No such file or directory
! d81656f...c93e7fe refs/pull/2498/merge -> origin/pr/2498/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2499/merge: No such file or directory
! 0e95aea...b83f68f refs/pull/2499/merge -> origin/pr/2499/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2500/merge: No such file or directory
! 49f46a4...f663556 refs/pull/2500/merge -> origin/pr/2500/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2501/merge: No such file or directory
! 4182356...a766154 refs/pull/2501/merge -> origin/pr/2501/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2502/merge: No such file or directory
! 56a66e6...5555365 refs/pull/2502/merge -> origin/pr/2502/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2505/merge: No such file or directory
! 97e38ea...e5eacbe refs/pull/2505/merge -> origin/pr/2505/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2506/merge: No such file or directory
! ee63e1b...5a729dd refs/pull/2506/merge -> origin/pr/2506/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2507/merge: No such file or directory
! 2784e86...a0fbd64 refs/pull/2507/merge -> origin/pr/2507/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2508/merge: No such file or directory
! 0e4277f...b7b5933 refs/pull/2508/merge -> origin/pr/2508/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2509/merge: No such file or directory
! 04f3604...fa95fd3 refs/pull/2509/merge -> origin/pr/2509/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2510/merge: No such file or directory
! bfca794...3b15fe0 refs/pull/2510/merge -> origin/pr/2510/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2511/merge: No such file or directory
! 82ccd8d...5800ae6 refs/pull/2511/merge -> origin/pr/2511/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/head: No such file or directory
! 039b399..1ab6a9a refs/pull/2512/head -> origin/pr/2512/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2512/merge: No such file or directory
! f0412ee...dce5a00 refs/pull/2512/merge -> origin/pr/2512/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2513/head: No such file or directory
! 6d04461..0afd8c4 refs/pull/2513/head -> origin/pr/2513/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2513/merge: No such file or directory
! f96a72f...ac43e77 refs/pull/2513/merge -> origin/pr/2513/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2514/merge: No such file or directory
! d1e921c...ee00648 refs/pull/2514/merge -> origin/pr/2514/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2515/merge: No such file or directory
! d3b3dcf...a17eded refs/pull/2515/merge -> origin/pr/2515/merge (unable to update local ref)
* [new ref] refs/pull/2516/head -> origin/pr/2516/head
* [new ref] refs/pull/2516/merge -> origin/pr/2516/merge
* [new ref] refs/pull/2517/head -> origin/pr/2517/head
* [new ref] refs/pull/2517/merge -> origin/pr/2517/merge
* [new ref] refs/pull/2518/head -> origin/pr/2518/head
* [new ref] refs/pull/2518/merge -> origin/pr/2518/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 943af0b...0121978 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision dc672f42083c375872d87030523545866cea4f55 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f dc672f42083c375872d87030523545866cea4f55
> git rev-list 435c3b4267f527543849db3777f021fecc5964df # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5507781482767896631.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8061654862004744830.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3339859183906304130.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7913208134909788415.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-13 00:02:44,068 30f016fd MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/30f016fd/pkb.log
2017-04-13 00:02:44,068 30f016fd MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-13 00:02:44,068 30f016fd MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-13 00:02:44,737 30f016fd MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-13 00:02:44,824 30f016fd MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-13 00:02:44,826 30f016fd MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-13 00:02:44,827 30f016fd MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-13 00:02:44,831 30f016fd MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-13 00:02:44,833 30f016fd MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-13 00:02:44,859 30f016fd MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-13 00:02:44,859 30f016fd MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/30f016fd/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #300
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/300/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-1722] Move PubsubIO into the google-cloud-platform module
[dhalperi] Use SdkComponents in WindowingStrategy.toProto
[lcwik] [BEAM-115] Update timer/state fields on ParDoPayload to use a map field
------------------------------------------
[...truncated 224.76 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 435c3b4267f527543849db3777f021fecc5964df (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 435c3b4267f527543849db3777f021fecc5964df
> git rev-list 82f2f2cff0f026800df465f1bff5451a7891ee13 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6754799537072330658.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2785449504838958491.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5038314372399967154.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2537669270750140512.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-12 18:05:58,376 93edaa3f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/93edaa3f/pkb.log
2017-04-12 18:05:58,377 93edaa3f MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-12 18:05:58,380 93edaa3f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-12 18:05:58,809 93edaa3f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-12 18:05:59,016 93edaa3f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-12 18:05:59,022 93edaa3f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-12 18:05:59,023 93edaa3f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-12 18:05:59,036 93edaa3f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-12 18:05:59,041 93edaa3f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-12 18:05:59,066 93edaa3f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-12 18:05:59,067 93edaa3f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/93edaa3f/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #299
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/299/display/redirect>
------------------------------------------
[...truncated 231.87 KB...]
remote: Counting objects: 3096, done.
remote: Compressing objects: 0% (1/177) remote: Compressing objects: 1% (2/177) remote: Compressing objects: 2% (4/177) remote: Compressing objects: 3% (6/177) remote: Compressing objects: 4% (8/177) remote: Compressing objects: 5% (9/177) remote: Compressing objects: 6% (11/177) remote: Compressing objects: 7% (13/177) remote: Compressing objects: 8% (15/177) remote: Compressing objects: 9% (16/177) remote: Compressing objects: 10% (18/177) remote: Compressing objects: 11% (20/177) remote: Compressing objects: 12% (22/177) remote: Compressing objects: 13% (24/177) remote: Compressing objects: 14% (25/177) remote: Compressing objects: 15% (27/177) remote: Compressing objects: 16% (29/177) remote: Compressing objects: 17% (31/177) remote: Compressing objects: 18% (32/177) remote: Compressing objects: 19% (34/177) remote: Compressing objects: 20% (36/177) remote: Compressing objects: 21% (38/177) remote: Compressing objects: 22% (39/177) remote: Compressing objects: 23% (41/177) remote: Compressing objects: 24% (43/177) remote: Compressing objects: 25% (45/177) remote: Compressing objects: 26% (47/177) remote: Compressing objects: 27% (48/177) remote: Compressing objects: 28% (50/177) remote: Compressing objects: 29% (52/177) remote: Compressing objects: 30% (54/177) remote: Compressing objects: 31% (55/177) remote: Compressing objects: 32% (57/177) remote: Compressing objects: 33% (59/177) remote: Compressing objects: 34% (61/177) remote: Compressing objects: 35% (62/177) remote: Compressing objects: 36% (64/177) remote: Compressing objects: 37% (66/177) remote: Compressing objects: 38% (68/177) remote: Compressing objects: 39% (70/177) remote: Compressing objects: 40% (71/177) remote: Compressing objects: 41% (73/177) remote: Compressing objects: 42% (75/177) remote: Compressing objects: 43% (77/177) remote: Compressing objects: 44% (78/177) remote: Compressing objects: 45% (80/177) remote: Compressing objects: 46% (82/177) remote: Compressing objects: 47% (84/177) remote: Compressing objects: 48% (85/177) remote: Compressing objects: 49% (87/177) remote: Compressing objects: 50% (89/177) remote: Compressing objects: 51% (91/177) remote: Compressing objects: 52% (93/177) remote: Compressing objects: 53% (94/177) remote: Compressing objects: 54% (96/177) remote: Compressing objects: 55% (98/177) remote: Compressing objects: 56% (100/177) remote: Compressing objects: 57% (101/177) remote: Compressing objects: 58% (103/177) remote: Compressing objects: 59% (105/177) remote: Compressing objects: 60% (107/177) remote: Compressing objects: 61% (108/177) remote: Compressing objects: 62% (110/177) remote: Compressing objects: 63% (112/177) remote: Compressing objects: 64% (114/177) remote: Compressing objects: 65% (116/177) remote: Compressing objects: 66% (117/177) remote: Compressing objects: 67% (119/177) remote: Compressing objects: 68% (121/177) remote: Compressing objects: 69% (123/177) remote: Compressing objects: 70% (124/177) remote: Compressing objects: 71% (126/177) remote: Compressing objects: 72% (128/177) remote: Compressing objects: 73% (130/177) remote: Compressing objects: 74% (131/177) remote: Compressing objects: 75% (133/177) remote: Compressing objects: 76% (135/177) remote: Compressing objects: 77% (137/177) remote: Compressing objects: 78% (139/177) remote: Compressing objects: 79% (140/177) remote: Compressing objects: 80% (142/177) remote: Compressing objects: 81% (144/177) remote: Compressing objects: 82% (146/177) remote: Compressing objects: 83% (147/177) remote: Compressing objects: 84% (149/177) remote: Compressing objects: 85% (151/177) remote: Compressing objects: 86% (153/177) remote: Compressing objects: 87% (154/177) remote: Compressing objects: 88% (156/177) remote: Compressing objects: 89% (158/177) remote: Compressing objects: 90% (160/177) remote: Compressing objects: 91% (162/177) remote: Compressing objects: 92% (163/177) remote: Compressing objects: 93% (165/177) remote: Compressing objects: 94% (167/177) remote: Compressing objects: 95% (169/177) remote: Compressing objects: 96% (170/177) remote: Compressing objects: 97% (172/177) remote: Compressing objects: 98% (174/177) remote: Compressing objects: 99% (176/177) remote: Compressing objects: 100% (177/177) remote: Compressing objects: 100% (177/177), done.
Receiving objects: 0% (1/3096) Receiving objects: 1% (31/3096) Receiving objects: 2% (62/3096) Receiving objects: 3% (93/3096) Receiving objects: 4% (124/3096) Receiving objects: 5% (155/3096) Receiving objects: 6% (186/3096) Receiving objects: 7% (217/3096) Receiving objects: 8% (248/3096) Receiving objects: 9% (279/3096) Receiving objects: 10% (310/3096) Receiving objects: 11% (341/3096) Receiving objects: 12% (372/3096) Receiving objects: 13% (403/3096) Receiving objects: 14% (434/3096) Receiving objects: 15% (465/3096) Receiving objects: 16% (496/3096) Receiving objects: 17% (527/3096) Receiving objects: 18% (558/3096) Receiving objects: 19% (589/3096) Receiving objects: 20% (620/3096) Receiving objects: 21% (651/3096) Receiving objects: 22% (682/3096) Receiving objects: 23% (713/3096) Receiving objects: 24% (744/3096) Receiving objects: 25% (774/3096) Receiving objects: 26% (805/3096) Receiving objects: 27% (836/3096) Receiving objects: 28% (867/3096) Receiving objects: 29% (898/3096) Receiving objects: 30% (929/3096) Receiving objects: 31% (960/3096) Receiving objects: 32% (991/3096) Receiving objects: 33% (1022/3096) Receiving objects: 34% (1053/3096) Receiving objects: 35% (1084/3096) Receiving objects: 36% (1115/3096) Receiving objects: 37% (1146/3096) Receiving objects: 38% (1177/3096) Receiving objects: 39% (1208/3096) Receiving objects: 40% (1239/3096) Receiving objects: 41% (1270/3096) Receiving objects: 42% (1301/3096) Receiving objects: 43% (1332/3096) Receiving objects: 44% (1363/3096) Receiving objects: 45% (1394/3096) Receiving objects: 46% (1425/3096) Receiving objects: 47% (1456/3096) Receiving objects: 48% (1487/3096) Receiving objects: 49% (1518/3096) Receiving objects: 50% (1548/3096) Receiving objects: 51% (1579/3096) Receiving objects: 52% (1610/3096) Receiving objects: 53% (1641/3096) Receiving objects: 54% (1672/3096) Receiving objects: 55% (1703/3096) Receiving objects: 56% (1734/3096) Receiving objects: 57% (1765/3096) Receiving objects: 58% (1796/3096) Receiving objects: 59% (1827/3096) Receiving objects: 60% (1858/3096) Receiving objects: 61% (1889/3096) Receiving objects: 62% (1920/3096) Receiving objects: 63% (1951/3096) Receiving objects: 64% (1982/3096) Receiving objects: 65% (2013/3096) Receiving objects: 66% (2044/3096) Receiving objects: 67% (2075/3096) Receiving objects: 68% (2106/3096) Receiving objects: 69% (2137/3096) Receiving objects: 70% (2168/3096) Receiving objects: 71% (2199/3096) Receiving objects: 72% (2230/3096) Receiving objects: 73% (2261/3096) Receiving objects: 74% (2292/3096) Receiving objects: 75% (2322/3096) Receiving objects: 76% (2353/3096) Receiving objects: 77% (2384/3096) Receiving objects: 78% (2415/3096) Receiving objects: 79% (2446/3096) Receiving objects: 80% (2477/3096) Receiving objects: 81% (2508/3096) Receiving objects: 82% (2539/3096) Receiving objects: 83% (2570/3096) Receiving objects: 84% (2601/3096) Receiving objects: 85% (2632/3096) Receiving objects: 86% (2663/3096) Receiving objects: 87% (2694/3096) Receiving objects: 88% (2725/3096) Receiving objects: 89% (2756/3096) Receiving objects: 90% (2787/3096) Receiving objects: 91% (2818/3096) Receiving objects: 92% (2849/3096) Receiving objects: 93% (2880/3096) remote: Total 3096 (delta 935), reused 860 (delta 860), pack-reused 2000
Receiving objects: 94% (2911/3096) Receiving objects: 95% (2942/3096) Receiving objects: 96% (2973/3096) Receiving objects: 97% (3004/3096) Receiving objects: 98% (3035/3096) Receiving objects: 99% (3066/3096) Receiving objects: 100% (3096/3096) Receiving objects: 100% (3096/3096), 483.98 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/1292) Resolving deltas: 1% (15/1292) Resolving deltas: 2% (26/1292) Resolving deltas: 3% (39/1292) Resolving deltas: 4% (53/1292) Resolving deltas: 5% (71/1292) Resolving deltas: 6% (78/1292) Resolving deltas: 8% (104/1292) Resolving deltas: 9% (123/1292) Resolving deltas: 10% (131/1292) Resolving deltas: 11% (144/1292) Resolving deltas: 13% (172/1292) Resolving deltas: 14% (185/1292) Resolving deltas: 16% (212/1292) Resolving deltas: 17% (220/1292) Resolving deltas: 18% (234/1292) Resolving deltas: 20% (259/1292) Resolving deltas: 21% (273/1292) Resolving deltas: 22% (297/1292) Resolving deltas: 23% (299/1292) Resolving deltas: 24% (313/1292) Resolving deltas: 25% (324/1292) Resolving deltas: 26% (338/1292) Resolving deltas: 27% (352/1292) Resolving deltas: 28% (364/1292) Resolving deltas: 29% (376/1292) Resolving deltas: 30% (388/1292) Resolving deltas: 32% (424/1292) Resolving deltas: 33% (433/1292) Resolving deltas: 34% (440/1292) Resolving deltas: 35% (457/1292) Resolving deltas: 36% (469/1292) Resolving deltas: 37% (479/1292) Resolving deltas: 38% (494/1292) Resolving deltas: 39% (511/1292) Resolving deltas: 40% (524/1292) Resolving deltas: 41% (530/1292) Resolving deltas: 43% (556/1292) Resolving deltas: 44% (571/1292) Resolving deltas: 45% (584/1292) Resolving deltas: 46% (595/1292) Resolving deltas: 47% (612/1292) Resolving deltas: 48% (622/1292) Resolving deltas: 49% (635/1292) Resolving deltas: 50% (648/1292) Resolving deltas: 51% (661/1292) Resolving deltas: 52% (672/1292) Resolving deltas: 53% (685/1292) Resolving deltas: 54% (698/1292) Resolving deltas: 55% (713/1292) Resolving deltas: 56% (724/1292) Resolving deltas: 57% (738/1292) Resolving deltas: 58% (754/1292) Resolving deltas: 59% (764/1292) Resolving deltas: 60% (776/1292) Resolving deltas: 61% (789/1292) Resolving deltas: 62% (806/1292) Resolving deltas: 63% (814/1292) Resolving deltas: 64% (828/1292) Resolving deltas: 65% (840/1292) Resolving deltas: 66% (854/1292) Resolving deltas: 67% (868/1292) Resolving deltas: 68% (879/1292) Resolving deltas: 69% (892/1292) Resolving deltas: 70% (906/1292) Resolving deltas: 71% (922/1292) Resolving deltas: 72% (931/1292) Resolving deltas: 73% (944/1292) Resolving deltas: 74% (959/1292) Resolving deltas: 75% (976/1292) Resolving deltas: 76% (982/1292) Resolving deltas: 77% (995/1292) Resolving deltas: 78% (1008/1292) Resolving deltas: 79% (1021/1292) Resolving deltas: 80% (1036/1292) Resolving deltas: 81% (1053/1292) Resolving deltas: 82% (1060/1292) Resolving deltas: 83% (1073/1292) Resolving deltas: 84% (1087/1292) Resolving deltas: 85% (1099/1292) Resolving deltas: 86% (1112/1292) Resolving deltas: 87% (1126/1292) Resolving deltas: 88% (1137/1292) Resolving deltas: 89% (1150/1292) Resolving deltas: 90% (1165/1292) Resolving deltas: 91% (1179/1292) Resolving deltas: 92% (1190/1292) Resolving deltas: 93% (1202/1292) Resolving deltas: 94% (1216/1292) Resolving deltas: 95% (1228/1292) Resolving deltas: 96% (1241/1292) Resolving deltas: 97% (1254/1292) Resolving deltas: 98% (1268/1292) Resolving deltas: 99% (1284/1292) Resolving deltas: 100% (1292/1292) Resolving deltas: 100% (1292/1292), completed with 424 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! 5bab984..71fecb2 refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! a0acfbf...36298fd refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
* [new ref] refs/pull/2488/head -> origin/pr/2488/head
* [new ref] refs/pull/2488/merge -> origin/pr/2488/merge
* [new ref] refs/pull/2489/head -> origin/pr/2489/head
* [new ref] refs/pull/2489/merge -> origin/pr/2489/merge
* [new ref] refs/pull/2490/head -> origin/pr/2490/head
* [new ref] refs/pull/2490/merge -> origin/pr/2490/merge
* [new ref] refs/pull/2491/head -> origin/pr/2491/head
* [new ref] refs/pull/2492/head -> origin/pr/2492/head
* [new ref] refs/pull/2492/merge -> origin/pr/2492/merge
* [new ref] refs/pull/2493/head -> origin/pr/2493/head
* [new ref] refs/pull/2493/merge -> origin/pr/2493/merge
* [new ref] refs/pull/2494/head -> origin/pr/2494/head
* [new ref] refs/pull/2495/head -> origin/pr/2495/head
* [new ref] refs/pull/2495/merge -> origin/pr/2495/merge
* [new ref] refs/pull/2496/head -> origin/pr/2496/head
* [new ref] refs/pull/2496/merge -> origin/pr/2496/merge
* [new ref] refs/pull/2497/head -> origin/pr/2497/head
* [new ref] refs/pull/2497/merge -> origin/pr/2497/merge
* [new ref] refs/pull/2498/head -> origin/pr/2498/head
* [new ref] refs/pull/2498/merge -> origin/pr/2498/merge
* [new ref] refs/pull/2499/head -> origin/pr/2499/head
* [new ref] refs/pull/2499/merge -> origin/pr/2499/merge
* [new ref] refs/pull/2500/head -> origin/pr/2500/head
* [new ref] refs/pull/2500/merge -> origin/pr/2500/merge
* [new ref] refs/pull/2501/head -> origin/pr/2501/head
* [new ref] refs/pull/2501/merge -> origin/pr/2501/merge
* [new ref] refs/pull/2502/head -> origin/pr/2502/head
* [new ref] refs/pull/2502/merge -> origin/pr/2502/merge
* [new ref] refs/pull/2503/head -> origin/pr/2503/head
* [new ref] refs/pull/2503/merge -> origin/pr/2503/merge
* [new ref] refs/pull/2504/head -> origin/pr/2504/head
* [new ref] refs/pull/2505/head -> origin/pr/2505/head
* [new ref] refs/pull/2505/merge -> origin/pr/2505/merge
* [new ref] refs/pull/2506/head -> origin/pr/2506/head
* [new ref] refs/pull/2506/merge -> origin/pr/2506/merge
* [new ref] refs/pull/2507/head -> origin/pr/2507/head
* [new ref] refs/pull/2507/merge -> origin/pr/2507/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 82f2f2cff0f026800df465f1bff5451a7891ee13 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 82f2f2cff0f026800df465f1bff5451a7891ee13
> git rev-list 82f2f2cff0f026800df465f1bff5451a7891ee13 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4592404064344980478.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6875976352852390598.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson627598438850954385.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1958208962707412236.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-12 12:02:43,249 f426b514 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/f426b514/pkb.log
2017-04-12 12:02:43,249 f426b514 MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-12 12:02:43,250 f426b514 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-12 12:02:43,643 f426b514 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-12 12:02:43,728 f426b514 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-12 12:02:43,730 f426b514 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-12 12:02:43,731 f426b514 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-12 12:02:43,736 f426b514 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-12 12:02:43,737 f426b514 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-12 12:02:43,763 f426b514 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-12 12:02:43,764 f426b514 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/f426b514/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #298
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/298/display/redirect?page=changes>
Changes:
[dhalperi] Triggers: handle missing case
------------------------------------------
[...truncated 254.70 KB...]
! 3419835...f293534 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! f1831b8...3b3df77 refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! 8770a40...04a1a10 refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! b10a4eb...9a7b24c refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
* [new ref] refs/pull/2488/head -> origin/pr/2488/head
* [new ref] refs/pull/2488/merge -> origin/pr/2488/merge
* [new ref] refs/pull/2489/head -> origin/pr/2489/head
* [new ref] refs/pull/2489/merge -> origin/pr/2489/merge
* [new ref] refs/pull/2490/head -> origin/pr/2490/head
* [new ref] refs/pull/2490/merge -> origin/pr/2490/merge
* [new ref] refs/pull/2491/head -> origin/pr/2491/head
* [new ref] refs/pull/2492/head -> origin/pr/2492/head
* [new ref] refs/pull/2492/merge -> origin/pr/2492/merge
* [new ref] refs/pull/2493/head -> origin/pr/2493/head
* [new ref] refs/pull/2493/merge -> origin/pr/2493/merge
* [new ref] refs/pull/2494/head -> origin/pr/2494/head
* [new ref] refs/pull/2495/head -> origin/pr/2495/head
* [new ref] refs/pull/2495/merge -> origin/pr/2495/merge
* [new ref] refs/pull/2496/head -> origin/pr/2496/head
* [new ref] refs/pull/2496/merge -> origin/pr/2496/merge
* [new ref] refs/pull/2497/head -> origin/pr/2497/head
* [new ref] refs/pull/2497/merge -> origin/pr/2497/merge
* [new ref] refs/pull/2498/head -> origin/pr/2498/head
* [new ref] refs/pull/2498/merge -> origin/pr/2498/merge
* [new ref] refs/pull/2499/head -> origin/pr/2499/head
* [new ref] refs/pull/2499/merge -> origin/pr/2499/merge
* [new ref] refs/pull/2500/head -> origin/pr/2500/head
* [new ref] refs/pull/2500/merge -> origin/pr/2500/merge
* [new ref] refs/pull/2501/head -> origin/pr/2501/head
* [new ref] refs/pull/2501/merge -> origin/pr/2501/merge
* [new ref] refs/pull/2502/head -> origin/pr/2502/head
* [new ref] refs/pull/2502/merge -> origin/pr/2502/merge
* [new ref] refs/pull/2503/head -> origin/pr/2503/head
* [new ref] refs/pull/2503/merge -> origin/pr/2503/merge
* [new ref] refs/pull/2504/head -> origin/pr/2504/head
* [new ref] refs/pull/2505/head -> origin/pr/2505/head
* [new ref] refs/pull/2505/merge -> origin/pr/2505/merge
* [new ref] refs/pull/2506/head -> origin/pr/2506/head
* [new ref] refs/pull/2506/merge -> origin/pr/2506/merge
* [new ref] refs/pull/2507/head -> origin/pr/2507/head
* [new ref] refs/pull/2507/merge -> origin/pr/2507/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! e9486c9...b9337f6 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 82f2f2cff0f026800df465f1bff5451a7891ee13 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 82f2f2cff0f026800df465f1bff5451a7891ee13
> git rev-list ccf247c1daa868cdaf441f918775c94ae6e3aa0b # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4622468083935983396.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson868300900290422740.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2258361619248153497.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4209423639641104359.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-12 06:03:28,925 4d7860d0 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/4d7860d0/pkb.log
2017-04-12 06:03:28,925 4d7860d0 MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-12 06:03:28,926 4d7860d0 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-12 06:03:29,270 4d7860d0 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-12 06:03:29,355 4d7860d0 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-12 06:03:29,358 4d7860d0 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-12 06:03:29,358 4d7860d0 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-12 06:03:29,363 4d7860d0 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-12 06:03:29,365 4d7860d0 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-12 06:03:29,391 4d7860d0 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-12 06:03:29,391 4d7860d0 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/4d7860d0/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #297
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/297/display/redirect?page=changes>
Changes:
[tgroh] Fix build breaks caused by overlaps between b615013 and c08b7b1
[robertwb] Ignore more python build artifacts.
[tgroh] Remove Orderdness of Input, Output expansions
[tgroh] Improve Work Rejection handling
[dhalperi] DataflowRunner misc cleanups
[dhalperi] DataflowRunner: send windowing strategy using Runner API proto
[altay] Throw specialized exception in value providers
[dhalperi] DataflowRunner: remove dead code
[tgroh] Clean HFIOWithEmbeddedCassandraTest before Execution
------------------------------------------
[...truncated 279.98 KB...]
! 2951b00...3b60b91 refs/pull/2441/merge -> origin/pr/2441/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2442/merge: No such file or directory
! 9fdd34f...27c3e86 refs/pull/2442/merge -> origin/pr/2442/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2444/merge: No such file or directory
! f2354aa...b597f15 refs/pull/2444/merge -> origin/pr/2444/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2445/merge: No such file or directory
! f0d8585...9f8a203 refs/pull/2445/merge -> origin/pr/2445/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2446/head: No such file or directory
! 4d36c50..4cb1273 refs/pull/2446/head -> origin/pr/2446/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2446/merge: No such file or directory
! c7f80bd...b652cd5 refs/pull/2446/merge -> origin/pr/2446/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2447/merge: No such file or directory
! 28d84dd...a8d46e5 refs/pull/2447/merge -> origin/pr/2447/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2449/merge: No such file or directory
! 16a3dee...7709d38 refs/pull/2449/merge -> origin/pr/2449/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2450/head: No such file or directory
! 1bdb766...98b7730 refs/pull/2450/head -> origin/pr/2450/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2450/merge: No such file or directory
! c68271d...9f80d4d refs/pull/2450/merge -> origin/pr/2450/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2451/merge: No such file or directory
! 111216a...04ed807 refs/pull/2451/merge -> origin/pr/2451/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2453/merge: No such file or directory
! cdf0221...34949af refs/pull/2453/merge -> origin/pr/2453/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2454/merge: No such file or directory
! 4763830...5070afd refs/pull/2454/merge -> origin/pr/2454/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2455/head: No such file or directory
! 71f7afa...29c2802 refs/pull/2455/head -> origin/pr/2455/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2456/merge: No such file or directory
! 323bad3...393fdff refs/pull/2456/merge -> origin/pr/2456/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2457/merge: No such file or directory
! 66bde8c...d67c07c refs/pull/2457/merge -> origin/pr/2457/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2458/merge: No such file or directory
! 6f99d16...6968a64 refs/pull/2458/merge -> origin/pr/2458/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2459/head: No such file or directory
! b55849d...6f8175f refs/pull/2459/head -> origin/pr/2459/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2459/merge: No such file or directory
! 59253cc...ea17233 refs/pull/2459/merge -> origin/pr/2459/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2460/head: No such file or directory
! 385ee0c...a714e8b refs/pull/2460/head -> origin/pr/2460/head (unable to update local ref)
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
* [new ref] refs/pull/2471/head -> origin/pr/2471/head
* [new ref] refs/pull/2471/merge -> origin/pr/2471/merge
* [new ref] refs/pull/2472/head -> origin/pr/2472/head
* [new ref] refs/pull/2472/merge -> origin/pr/2472/merge
* [new ref] refs/pull/2473/head -> origin/pr/2473/head
* [new ref] refs/pull/2473/merge -> origin/pr/2473/merge
* [new ref] refs/pull/2474/head -> origin/pr/2474/head
* [new ref] refs/pull/2474/merge -> origin/pr/2474/merge
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
* [new ref] refs/pull/2488/head -> origin/pr/2488/head
* [new ref] refs/pull/2488/merge -> origin/pr/2488/merge
* [new ref] refs/pull/2489/head -> origin/pr/2489/head
* [new ref] refs/pull/2489/merge -> origin/pr/2489/merge
* [new ref] refs/pull/2490/head -> origin/pr/2490/head
* [new ref] refs/pull/2490/merge -> origin/pr/2490/merge
* [new ref] refs/pull/2491/head -> origin/pr/2491/head
* [new ref] refs/pull/2492/head -> origin/pr/2492/head
* [new ref] refs/pull/2492/merge -> origin/pr/2492/merge
* [new ref] refs/pull/2493/head -> origin/pr/2493/head
* [new ref] refs/pull/2493/merge -> origin/pr/2493/merge
* [new ref] refs/pull/2494/head -> origin/pr/2494/head
* [new ref] refs/pull/2495/head -> origin/pr/2495/head
* [new ref] refs/pull/2495/merge -> origin/pr/2495/merge
* [new ref] refs/pull/2496/head -> origin/pr/2496/head
* [new ref] refs/pull/2496/merge -> origin/pr/2496/merge
* [new ref] refs/pull/2497/head -> origin/pr/2497/head
* [new ref] refs/pull/2497/merge -> origin/pr/2497/merge
* [new ref] refs/pull/2498/head -> origin/pr/2498/head
* [new ref] refs/pull/2498/merge -> origin/pr/2498/merge
* [new ref] refs/pull/2499/head -> origin/pr/2499/head
* [new ref] refs/pull/2499/merge -> origin/pr/2499/merge
* [new ref] refs/pull/2500/head -> origin/pr/2500/head
* [new ref] refs/pull/2500/merge -> origin/pr/2500/merge
* [new ref] refs/pull/2501/head -> origin/pr/2501/head
* [new ref] refs/pull/2501/merge -> origin/pr/2501/merge
* [new ref] refs/pull/2502/head -> origin/pr/2502/head
* [new ref] refs/pull/2502/merge -> origin/pr/2502/merge
* [new ref] refs/pull/2503/head -> origin/pr/2503/head
* [new ref] refs/pull/2503/merge -> origin/pr/2503/merge
* [new ref] refs/pull/2504/head -> origin/pr/2504/head
* [new ref] refs/pull/2504/merge -> origin/pr/2504/merge
* [new ref] refs/pull/2505/head -> origin/pr/2505/head
* [new ref] refs/pull/2505/merge -> origin/pr/2505/merge
error: unable to resolve reference refs/remotes/origin/pr/278/merge: No such file or directory
! 319114d...4c5e015 refs/pull/278/merge -> origin/pr/278/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! a0f9042...19675f4 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/314/merge: No such file or directory
! 0fdd146...049852e refs/pull/314/merge -> origin/pr/314/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/455/merge: No such file or directory
! 54d38cf...895dfbd refs/pull/455/merge -> origin/pr/455/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 41889ce...81e605c refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam7(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ccf247c1daa868cdaf441f918775c94ae6e3aa0b (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ccf247c1daa868cdaf441f918775c94ae6e3aa0b
> git rev-list 38cf23ebe34724b24db390e1bca774c7c77fdd21 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3651263043698769162.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2487658971994449677.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3370579392091835895.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1562026453500387935.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-12 00:05:41,928 9a40508f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/9a40508f/pkb.log
2017-04-12 00:05:41,928 9a40508f MainThread INFO PerfKitBenchmarker version: v1.11.0-38-g9e130a4
2017-04-12 00:05:41,928 9a40508f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-12 00:05:42,307 9a40508f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-12 00:05:42,469 9a40508f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-12 00:05:42,471 9a40508f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-12 00:05:42,472 9a40508f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-12 00:05:42,478 9a40508f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-12 00:05:42,481 9a40508f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-12 00:05:42,497 9a40508f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-12 00:05:42,497 9a40508f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/9a40508f/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #296
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/296/display/redirect?page=changes>
Changes:
[dhalperi] PubsubIO: remove support for BoundedReader
[dhalperi] Move HashingFn to io/common, switch to better hash
[iemejia] Flip dependency edge between Dataflow runner and IO-GCP
[tgroh] Add Coder utilities for Proto conversions
[dhalperi] Improve HadoopInputFormatIO DisplayData and Cassandra tests
[tgroh] Remove Jdk1.8-tests/.toDelete
------------------------------------------
[...truncated 249.74 KB...]
! 7e0dd10...2cc86f5 refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! bace20f...08ad8b2 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 49f1638...e32d8df refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2378/merge: No such file or directory
! c6d11ae...01ec401 refs/pull/2378/merge -> origin/pr/2378/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 1cc81ea...a1da37d refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2403/merge: No such file or directory
! cd78b7b...18c9ac1 refs/pull/2403/merge -> origin/pr/2403/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! bbb3c84...ca34b8a refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! e09eec6...180830b refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! cef4000...09d8aa8 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! d6345c3...8fd4d87 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! dcd42cd..5bab984 refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 9ea0cc0...fa6a060 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! ab88227...2b1cbb1 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! 7916f75...5f85d8a refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 53495b0...3419835 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! 511da9c...8770a40 refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2472/merge: No such file or directory
! 41eca59...001fecf refs/pull/2472/merge -> origin/pr/2472/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! 4aa78db...c626faa refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 4865948...b10a4eb refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
* [new ref] refs/pull/2488/head -> origin/pr/2488/head
* [new ref] refs/pull/2488/merge -> origin/pr/2488/merge
* [new ref] refs/pull/2489/head -> origin/pr/2489/head
* [new ref] refs/pull/2489/merge -> origin/pr/2489/merge
* [new ref] refs/pull/2490/head -> origin/pr/2490/head
* [new ref] refs/pull/2490/merge -> origin/pr/2490/merge
* [new ref] refs/pull/2491/head -> origin/pr/2491/head
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 5ba5975...e9486c9 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 38cf23ebe34724b24db390e1bca774c7c77fdd21 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 38cf23ebe34724b24db390e1bca774c7c77fdd21
> git rev-list c58f4f89b3026e130b63dc14731a8ee8615e92f5 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson448908302825638812.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4554872022290710881.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7512356137614356356.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2475321513012371134.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-11 18:02:53,034 ea37d95d MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/ea37d95d/pkb.log
2017-04-11 18:02:53,035 ea37d95d MainThread INFO PerfKitBenchmarker version: v1.11.0-37-g0254d50
2017-04-11 18:02:53,035 ea37d95d MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-11 18:02:53,485 ea37d95d MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-11 18:02:53,644 ea37d95d MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-11 18:02:53,648 ea37d95d MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-11 18:02:53,649 ea37d95d MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-11 18:02:53,657 ea37d95d MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-11 18:02:53,660 ea37d95d MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-11 18:02:53,701 ea37d95d MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-11 18:02:53,701 ea37d95d MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/ea37d95d/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #295
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/295/display/redirect>
------------------------------------------
[...truncated 250.46 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! fdd0457...bace20f refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 3a62a5a...49f1638 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! cd1e7e6...6650613 refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 02f01ea...dac3854 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/head: No such file or directory
! 3b30027...b4ce660 refs/pull/2401/head -> origin/pr/2401/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 371a50d...1cc81ea refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/head: No such file or directory
! a078017...a69b46b refs/pull/2406/head -> origin/pr/2406/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 4e897ad...bbb3c84 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! 52cf5f4...e09eec6 refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 66fcdf4...cef4000 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 1ca8b79...d6345c3 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! 9f7f850...dcd42cd refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! ff6e93b...9ea0cc0 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/head: No such file or directory
! f413860...943322c refs/pull/2426/head -> origin/pr/2426/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! e325586...ab88227 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/head: No such file or directory
! d22f59a...58c0832 refs/pull/2430/head -> origin/pr/2430/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! 9d893e6...7916f75 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 91867d9...53495b0 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! 679f861...511da9c refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! 8a475ce...4aa78db refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 4da4e4b...4865948 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
* [new ref] refs/pull/2488/head -> origin/pr/2488/head
* [new ref] refs/pull/2488/merge -> origin/pr/2488/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 1b17b7a...5ba5975 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor807.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c58f4f89b3026e130b63dc14731a8ee8615e92f5 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c58f4f89b3026e130b63dc14731a8ee8615e92f5
> git rev-list c58f4f89b3026e130b63dc14731a8ee8615e92f5 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1949621806901968530.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5062811182093203483.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6812104366523762537.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5050271534221786868.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-11 12:02:48,460 37010055 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/37010055/pkb.log
2017-04-11 12:02:48,460 37010055 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-11 12:02:48,461 37010055 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-11 12:02:48,821 37010055 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-11 12:02:48,910 37010055 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-11 12:02:48,913 37010055 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-11 12:02:48,913 37010055 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-11 12:02:48,918 37010055 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-11 12:02:48,927 37010055 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-11 12:02:48,944 37010055 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-11 12:02:48,945 37010055 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/37010055/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #294
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/294/display/redirect?page=changes>
Changes:
[tgroh] Move WindowingStrategies to runners-core-construction
[kirpichov] Removes DoFn.ProcessContinuation completely
[kirpichov] Bump Dataflow worker to 20170410
------------------------------------------
[...truncated 278.84 KB...]
* [new ref] refs/pull/2423/head -> origin/pr/2423/head
* [new ref] refs/pull/2423/merge -> origin/pr/2423/merge
* [new ref] refs/pull/2424/head -> origin/pr/2424/head
* [new ref] refs/pull/2424/merge -> origin/pr/2424/merge
* [new ref] refs/pull/2425/head -> origin/pr/2425/head
* [new ref] refs/pull/2426/head -> origin/pr/2426/head
* [new ref] refs/pull/2426/merge -> origin/pr/2426/merge
* [new ref] refs/pull/2427/head -> origin/pr/2427/head
* [new ref] refs/pull/2427/merge -> origin/pr/2427/merge
* [new ref] refs/pull/2428/head -> origin/pr/2428/head
* [new ref] refs/pull/2428/merge -> origin/pr/2428/merge
* [new ref] refs/pull/2429/head -> origin/pr/2429/head
* [new ref] refs/pull/2430/head -> origin/pr/2430/head
* [new ref] refs/pull/2430/merge -> origin/pr/2430/merge
* [new ref] refs/pull/2431/head -> origin/pr/2431/head
* [new ref] refs/pull/2431/merge -> origin/pr/2431/merge
* [new ref] refs/pull/2432/head -> origin/pr/2432/head
* [new ref] refs/pull/2432/merge -> origin/pr/2432/merge
* [new ref] refs/pull/2433/head -> origin/pr/2433/head
* [new ref] refs/pull/2433/merge -> origin/pr/2433/merge
* [new ref] refs/pull/2434/head -> origin/pr/2434/head
* [new ref] refs/pull/2434/merge -> origin/pr/2434/merge
* [new ref] refs/pull/2435/head -> origin/pr/2435/head
* [new ref] refs/pull/2435/merge -> origin/pr/2435/merge
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
* [new ref] refs/pull/2471/head -> origin/pr/2471/head
* [new ref] refs/pull/2471/merge -> origin/pr/2471/merge
* [new ref] refs/pull/2472/head -> origin/pr/2472/head
* [new ref] refs/pull/2472/merge -> origin/pr/2472/merge
* [new ref] refs/pull/2473/head -> origin/pr/2473/head
* [new ref] refs/pull/2473/merge -> origin/pr/2473/merge
* [new ref] refs/pull/2474/head -> origin/pr/2474/head
* [new ref] refs/pull/2474/merge -> origin/pr/2474/merge
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
error: unable to resolve reference refs/remotes/origin/pr/278/merge: No such file or directory
! 319114d...4c5e015 refs/pull/278/merge -> origin/pr/278/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! a0f9042...19675f4 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/311/merge: No such file or directory
! 9cbefd4...b1b5420 refs/pull/311/merge -> origin/pr/311/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/314/merge: No such file or directory
! 0fdd146...049852e refs/pull/314/merge -> origin/pr/314/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/455/merge: No such file or directory
! 54d38cf...895dfbd refs/pull/455/merge -> origin/pr/455/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! fbb6f89...5ba5975 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! d5dd848...7a7cff5 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c58f4f89b3026e130b63dc14731a8ee8615e92f5 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c58f4f89b3026e130b63dc14731a8ee8615e92f5
> git rev-list 7fd9c6516e2222a5f3d290fd95507559b0c99940 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4079288884855686022.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2238358916724584886.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2730163199137378929.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8354405683946942183.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-11 06:02:32,985 df397436 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/df397436/pkb.log
2017-04-11 06:02:32,985 df397436 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-11 06:02:32,986 df397436 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-11 06:02:33,725 df397436 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-11 06:02:33,840 df397436 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-11 06:02:33,842 df397436 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-11 06:02:33,842 df397436 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-11 06:02:33,849 df397436 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-11 06:02:33,851 df397436 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-11 06:02:33,870 df397436 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-11 06:02:33,871 df397436 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/df397436/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #293
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/293/display/redirect?page=changes>
Changes:
[kirpichov] BEAM-1053 ApexGroupByKeyOperator serialization issues
[chamikara] Create as custom source
[tgroh] Add SdkComponents
[altay] Upgrade dependencies.
[altay] Skip query metrics when creating a template
[altay] Fix GroupByKeyInputVisitor for Direct Runner
------------------------------------------
[...truncated 251.35 KB...]
! 182841a...3a62a5a refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 5e54b6a...61df746 refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2378/merge: No such file or directory
! 8a8f567...c6d11ae refs/pull/2378/merge -> origin/pr/2378/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! e9bfd19...3b11d5e refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! d3a70c5...02f01ea refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 22cbe49...371a50d refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! bfea969...4e897ad refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 93c22ac...f06b0c8 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2411/merge: No such file or directory
! 2a9d9fa...a96af72 refs/pull/2411/merge -> origin/pr/2411/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! fec945f...49fd3ee refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/head: No such file or directory
! e9c395d...d4a71fe refs/pull/2415/head -> origin/pr/2415/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! 867d5d1...52cf5f4 refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! b08de25...66fcdf4 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 6aabe68...1ca8b79 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! eae8214...ff6e93b refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 1874e21...e325586 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/head: No such file or directory
! 854b3a9...d22f59a refs/pull/2430/head -> origin/pr/2430/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! 1daa0d2...9d893e6 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 87049e0...91867d9 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! 452cd35...679f861 refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! f432126...8a475ce refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 52946db...4da4e4b refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
* [new ref] refs/pull/2482/head -> origin/pr/2482/head
* [new ref] refs/pull/2482/merge -> origin/pr/2482/merge
* [new ref] refs/pull/2483/head -> origin/pr/2483/head
* [new ref] refs/pull/2483/merge -> origin/pr/2483/merge
* [new ref] refs/pull/2484/head -> origin/pr/2484/head
* [new ref] refs/pull/2484/merge -> origin/pr/2484/merge
* [new ref] refs/pull/2485/head -> origin/pr/2485/head
* [new ref] refs/pull/2485/merge -> origin/pr/2485/merge
* [new ref] refs/pull/2486/head -> origin/pr/2486/head
* [new ref] refs/pull/2486/merge -> origin/pr/2486/merge
* [new ref] refs/pull/2487/head -> origin/pr/2487/head
* [new ref] refs/pull/2487/merge -> origin/pr/2487/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! bd11ed1...1b17b7a refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 7fd9c6516e2222a5f3d290fd95507559b0c99940 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 7fd9c6516e2222a5f3d290fd95507559b0c99940
> git rev-list 80d2548f258074931a62e412609363dfd2305086 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1645119501670945800.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3306673871647910488.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8230417350239447705.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5402830510053080050.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-11 00:02:39,195 eb108d41 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/eb108d41/pkb.log
2017-04-11 00:02:39,195 eb108d41 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-11 00:02:39,196 eb108d41 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-11 00:02:39,604 eb108d41 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-11 00:02:39,695 eb108d41 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-11 00:02:39,698 eb108d41 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-11 00:02:39,698 eb108d41 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-11 00:02:39,703 eb108d41 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-11 00:02:39,705 eb108d41 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-11 00:02:39,727 eb108d41 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-11 00:02:39,728 eb108d41 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/eb108d41/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #292
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/292/display/redirect?page=changes>
Changes:
[altay] better log message for bigquery temp tables
[dhalperi] BEAM-1390 Update top level README.md to include Apex Runner
[dhalperi] [BEAM-386] Move UnboundedReadFromBoundedSource to core-construction-java
[altay] enable test_multi_valued_singleton_side_input test
------------------------------------------
[...truncated 251.79 KB...]
! c666b42...5c504b9 refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! 6c67869...fc1ce54 refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! b642536...e9bfd19 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! 3caf915...5e05e82 refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! 345486b...d9f176e refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 836c0be...614baf7 refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 27d2beb...22cbe49 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2403/merge: No such file or directory
! 580df8b...cd78b7b refs/pull/2403/merge -> origin/pr/2403/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 382cd34...bfea969 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2407/merge: No such file or directory
! 94750e5...928d4e7 refs/pull/2407/merge -> origin/pr/2407/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2409/merge: No such file or directory
! 3b743c1...63f8ac5 refs/pull/2409/merge -> origin/pr/2409/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! a3e4c50...93c22ac refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2412/merge: No such file or directory
! 2800ff1...ae52d64 refs/pull/2412/merge -> origin/pr/2412/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! fb3db3b...fec945f refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 6d079a4...b08de25 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2420/merge: No such file or directory
! 1bea85f...1fde8b4 refs/pull/2420/merge -> origin/pr/2420/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 272146e...6aabe68 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! 7ae9488..9f7f850 refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 5b1da5f...eae8214 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2424/merge: No such file or directory
! 31e480e...6de35a8 refs/pull/2424/merge -> origin/pr/2424/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 720cf4e...1874e21 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2427/merge: No such file or directory
! 4586537...7de910f refs/pull/2427/merge -> origin/pr/2427/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 11fd22c...87049e0 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 87d000f...dea7fc9 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! 46a033f...452cd35 refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2472/merge: No such file or directory
! 763eeae...41eca59 refs/pull/2472/merge -> origin/pr/2472/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! a77034f...f432126 refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! a5295e3...52946db refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
* [new ref] refs/pull/2480/head -> origin/pr/2480/head
* [new ref] refs/pull/2480/merge -> origin/pr/2480/merge
* [new ref] refs/pull/2481/head -> origin/pr/2481/head
* [new ref] refs/pull/2481/merge -> origin/pr/2481/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 83f830c...bd11ed1 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 80d2548f258074931a62e412609363dfd2305086 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 80d2548f258074931a62e412609363dfd2305086
> git rev-list 713701ddc43c3987e261ecd08b34131ea80c3999 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5653674010038454435.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6325567562008076038.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8567885456195142124.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5138431011048524145.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-10 18:02:50,492 cdbdee68 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/cdbdee68/pkb.log
2017-04-10 18:02:50,492 cdbdee68 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-10 18:02:50,493 cdbdee68 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-10 18:02:50,820 cdbdee68 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-10 18:02:50,909 cdbdee68 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-10 18:02:50,911 cdbdee68 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-10 18:02:50,912 cdbdee68 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-10 18:02:50,918 cdbdee68 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-10 18:02:50,920 cdbdee68 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-10 18:02:50,944 cdbdee68 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-10 18:02:50,944 cdbdee68 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/cdbdee68/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #291
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/291/display/redirect>
------------------------------------------
[...truncated 229.76 KB...]
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 2184, done.
remote: Compressing objects: 2% (1/37) remote: Compressing objects: 5% (2/37) remote: Compressing objects: 8% (3/37) remote: Compressing objects: 10% (4/37) remote: Compressing objects: 13% (5/37) remote: Compressing objects: 16% (6/37) remote: Compressing objects: 18% (7/37) remote: Compressing objects: 21% (8/37) remote: Compressing objects: 24% (9/37) remote: Compressing objects: 27% (10/37) remote: Compressing objects: 29% (11/37) remote: Compressing objects: 32% (12/37) remote: Compressing objects: 35% (13/37) remote: Compressing objects: 37% (14/37) remote: Compressing objects: 40% (15/37) remote: Compressing objects: 43% (16/37) remote: Compressing objects: 45% (17/37) remote: Compressing objects: 48% (18/37) remote: Compressing objects: 51% (19/37) remote: Compressing objects: 54% (20/37) remote: Compressing objects: 56% (21/37) remote: Compressing objects: 59% (22/37) remote: Compressing objects: 62% (23/37) remote: Compressing objects: 64% (24/37) remote: Compressing objects: 67% (25/37) remote: Compressing objects: 70% (26/37) remote: Compressing objects: 72% (27/37) remote: Compressing objects: 75% (28/37) remote: Compressing objects: 78% (29/37) remote: Compressing objects: 81% (30/37) remote: Compressing objects: 83% (31/37) remote: Compressing objects: 86% (32/37) remote: Compressing objects: 89% (33/37) remote: Compressing objects: 91% (34/37) remote: Compressing objects: 94% (35/37) remote: Compressing objects: 97% (36/37) remote: Compressing objects: 100% (37/37) remote: Compressing objects: 100% (37/37), done.
Receiving objects: 0% (1/2184) Receiving objects: 1% (22/2184) Receiving objects: 2% (44/2184) Receiving objects: 3% (66/2184) Receiving objects: 4% (88/2184) Receiving objects: 5% (110/2184) Receiving objects: 6% (132/2184) Receiving objects: 7% (153/2184) Receiving objects: 8% (175/2184) Receiving objects: 9% (197/2184) Receiving objects: 10% (219/2184) Receiving objects: 11% (241/2184) Receiving objects: 12% (263/2184) Receiving objects: 13% (284/2184) Receiving objects: 14% (306/2184) Receiving objects: 15% (328/2184) Receiving objects: 16% (350/2184) Receiving objects: 17% (372/2184) Receiving objects: 18% (394/2184) Receiving objects: 19% (415/2184) Receiving objects: 20% (437/2184) Receiving objects: 21% (459/2184) Receiving objects: 22% (481/2184) Receiving objects: 23% (503/2184) Receiving objects: 24% (525/2184) Receiving objects: 25% (546/2184) Receiving objects: 26% (568/2184) Receiving objects: 27% (590/2184) Receiving objects: 28% (612/2184) Receiving objects: 29% (634/2184) Receiving objects: 30% (656/2184) Receiving objects: 31% (678/2184) Receiving objects: 32% (699/2184) Receiving objects: 33% (721/2184) Receiving objects: 34% (743/2184) Receiving objects: 35% (765/2184) Receiving objects: 36% (787/2184) Receiving objects: 37% (809/2184) Receiving objects: 38% (830/2184) Receiving objects: 39% (852/2184) Receiving objects: 40% (874/2184) Receiving objects: 41% (896/2184) Receiving objects: 42% (918/2184) Receiving objects: 43% (940/2184) Receiving objects: 44% (961/2184) Receiving objects: 45% (983/2184) Receiving objects: 46% (1005/2184) Receiving objects: 47% (1027/2184) Receiving objects: 48% (1049/2184) Receiving objects: 49% (1071/2184) Receiving objects: 50% (1092/2184) Receiving objects: 51% (1114/2184) Receiving objects: 52% (1136/2184) Receiving objects: 53% (1158/2184) Receiving objects: 54% (1180/2184) Receiving objects: 55% (1202/2184) Receiving objects: 56% (1224/2184) Receiving objects: 57% (1245/2184) Receiving objects: 58% (1267/2184) Receiving objects: 59% (1289/2184) Receiving objects: 60% (1311/2184) Receiving objects: 61% (1333/2184) Receiving objects: 62% (1355/2184) Receiving objects: 63% (1376/2184) Receiving objects: 64% (1398/2184) Receiving objects: 65% (1420/2184) Receiving objects: 66% (1442/2184) Receiving objects: 67% (1464/2184) Receiving objects: 68% (1486/2184) Receiving objects: 69% (1507/2184) Receiving objects: 70% (1529/2184) Receiving objects: 71% (1551/2184) Receiving objects: 72% (1573/2184) Receiving objects: 73% (1595/2184) Receiving objects: 74% (1617/2184) Receiving objects: 75% (1638/2184) Receiving objects: 76% (1660/2184) Receiving objects: 77% (1682/2184) Receiving objects: 78% (1704/2184) Receiving objects: 79% (1726/2184) Receiving objects: 80% (1748/2184) Receiving objects: 81% (1770/2184) Receiving objects: 82% (1791/2184) Receiving objects: 83% (1813/2184) Receiving objects: 84% (1835/2184) Receiving objects: 85% (1857/2184) Receiving objects: 86% (1879/2184) Receiving objects: 87% (1901/2184) Receiving objects: 88% (1922/2184) Receiving objects: 89% (1944/2184) Receiving objects: 90% (1966/2184) Receiving objects: 91% (1988/2184) Receiving objects: 92% (2010/2184) Receiving objects: 93% (2032/2184) Receiving objects: 94% (2053/2184) Receiving objects: 95% (2075/2184) Receiving objects: 96% (2097/2184) Receiving objects: 97% (2119/2184) Receiving objects: 98% (2141/2184) remote: Total 2184 (delta 653), reused 642 (delta 642), pack-reused 1505
Receiving objects: 99% (2163/2184) Receiving objects: 100% (2184/2184) Receiving objects: 100% (2184/2184), 340.58 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/989) Resolving deltas: 1% (17/989) Resolving deltas: 2% (20/989) Resolving deltas: 3% (38/989) Resolving deltas: 5% (57/989) Resolving deltas: 6% (60/989) Resolving deltas: 7% (79/989) Resolving deltas: 8% (80/989) Resolving deltas: 10% (103/989) Resolving deltas: 12% (125/989) Resolving deltas: 13% (134/989) Resolving deltas: 15% (155/989) Resolving deltas: 16% (164/989) Resolving deltas: 17% (173/989) Resolving deltas: 18% (181/989) Resolving deltas: 19% (188/989) Resolving deltas: 20% (199/989) Resolving deltas: 21% (215/989) Resolving deltas: 22% (219/989) Resolving deltas: 23% (228/989) Resolving deltas: 24% (246/989) Resolving deltas: 25% (250/989) Resolving deltas: 26% (259/989) Resolving deltas: 27% (269/989) Resolving deltas: 28% (277/989) Resolving deltas: 29% (290/989) Resolving deltas: 30% (297/989) Resolving deltas: 31% (307/989) Resolving deltas: 32% (318/989) Resolving deltas: 33% (327/989) Resolving deltas: 34% (338/989) Resolving deltas: 35% (347/989) Resolving deltas: 40% (396/989) Resolving deltas: 41% (410/989) Resolving deltas: 42% (417/989) Resolving deltas: 44% (436/989) Resolving deltas: 45% (448/989) Resolving deltas: 46% (455/989) Resolving deltas: 47% (467/989) Resolving deltas: 48% (476/989) Resolving deltas: 50% (495/989) Resolving deltas: 51% (507/989) Resolving deltas: 52% (520/989) Resolving deltas: 53% (525/989) Resolving deltas: 54% (535/989) Resolving deltas: 55% (544/989) Resolving deltas: 56% (559/989) Resolving deltas: 57% (564/989) Resolving deltas: 58% (574/989) Resolving deltas: 59% (590/989) Resolving deltas: 60% (596/989) Resolving deltas: 61% (604/989) Resolving deltas: 62% (614/989) Resolving deltas: 63% (624/989) Resolving deltas: 64% (633/989) Resolving deltas: 65% (645/989) Resolving deltas: 66% (653/989) Resolving deltas: 67% (667/989) Resolving deltas: 68% (673/989) Resolving deltas: 69% (685/989) Resolving deltas: 70% (694/989) Resolving deltas: 71% (703/989) Resolving deltas: 72% (714/989) Resolving deltas: 73% (722/989) Resolving deltas: 74% (732/989) Resolving deltas: 75% (742/989) Resolving deltas: 76% (752/989) Resolving deltas: 77% (762/989) Resolving deltas: 78% (772/989) Resolving deltas: 79% (784/989) Resolving deltas: 80% (792/989) Resolving deltas: 81% (802/989) Resolving deltas: 82% (818/989) Resolving deltas: 83% (821/989) Resolving deltas: 84% (834/989) Resolving deltas: 85% (841/989) Resolving deltas: 86% (851/989) Resolving deltas: 87% (861/989) Resolving deltas: 88% (871/989) Resolving deltas: 89% (881/989) Resolving deltas: 90% (892/989) Resolving deltas: 91% (900/989) Resolving deltas: 92% (912/989) Resolving deltas: 93% (920/989) Resolving deltas: 94% (930/989) Resolving deltas: 95% (941/989) Resolving deltas: 96% (950/989) Resolving deltas: 97% (960/989) Resolving deltas: 98% (970/989) Resolving deltas: 99% (980/989) Resolving deltas: 100% (989/989) Resolving deltas: 100% (989/989), completed with 303 local objects.
error: unable to resolve reference refs/remotes/origin/pr/1887/merge: No such file or directory
! 3d5f7d2...c530cbe refs/pull/1887/merge -> origin/pr/1887/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1899/merge: No such file or directory
! c149982...ff63224 refs/pull/1899/merge -> origin/pr/1899/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1916/merge: No such file or directory
! acaa7ff...e7c4bb9 refs/pull/1916/merge -> origin/pr/1916/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2003/merge: No such file or directory
! f31c659...5aca74c refs/pull/2003/merge -> origin/pr/2003/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2143/merge: No such file or directory
! 392ba68...5a50884 refs/pull/2143/merge -> origin/pr/2143/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2289/merge: No such file or directory
! 9f50540...fdc896c refs/pull/2289/merge -> origin/pr/2289/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! ab591fc...d3a70c5 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2460/merge -> origin/pr/2460/merge
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 713701ddc43c3987e261ecd08b34131ea80c3999 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 713701ddc43c3987e261ecd08b34131ea80c3999
> git rev-list 713701ddc43c3987e261ecd08b34131ea80c3999 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4762333452496904294.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4303981831724342969.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4425289131072876230.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1697533547553331619.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-10 12:02:33,865 e05f0090 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/e05f0090/pkb.log
2017-04-10 12:02:33,869 e05f0090 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-10 12:02:33,870 e05f0090 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-10 12:02:34,387 e05f0090 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-10 12:02:34,474 e05f0090 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-10 12:02:34,476 e05f0090 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-10 12:02:34,476 e05f0090 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-10 12:02:34,482 e05f0090 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-10 12:02:34,484 e05f0090 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-10 12:02:34,509 e05f0090 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-10 12:02:34,510 e05f0090 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/e05f0090/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #290
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/290/display/redirect>
------------------------------------------
[...truncated 230.50 KB...]
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 2541, done.
remote: Compressing objects: 0% (1/128) remote: Compressing objects: 1% (2/128) remote: Compressing objects: 2% (3/128) remote: Compressing objects: 3% (4/128) remote: Compressing objects: 4% (6/128) remote: Compressing objects: 5% (7/128) remote: Compressing objects: 6% (8/128) remote: Compressing objects: 7% (9/128) remote: Compressing objects: 8% (11/128) remote: Compressing objects: 9% (12/128) remote: Compressing objects: 10% (13/128) remote: Compressing objects: 11% (15/128) remote: Compressing objects: 12% (16/128) remote: Compressing objects: 13% (17/128) remote: Compressing objects: 14% (18/128) remote: Compressing objects: 15% (20/128) remote: Compressing objects: 16% (21/128) remote: Compressing objects: 17% (22/128) remote: Compressing objects: 18% (24/128) remote: Compressing objects: 19% (25/128) remote: Compressing objects: 20% (26/128) remote: Compressing objects: 21% (27/128) remote: Compressing objects: 22% (29/128) remote: Compressing objects: 23% (30/128) remote: Compressing objects: 24% (31/128) remote: Compressing objects: 25% (32/128) remote: Compressing objects: 26% (34/128) remote: Compressing objects: 27% (35/128) remote: Compressing objects: 28% (36/128) remote: Compressing objects: 29% (38/128) remote: Compressing objects: 30% (39/128) remote: Compressing objects: 31% (40/128) remote: Compressing objects: 32% (41/128) remote: Compressing objects: 33% (43/128) remote: Compressing objects: 34% (44/128) remote: Compressing objects: 35% (45/128) remote: Compressing objects: 36% (47/128) remote: Compressing objects: 37% (48/128) remote: Compressing objects: 38% (49/128) remote: Compressing objects: 39% (50/128) remote: Compressing objects: 40% (52/128) remote: Compressing objects: 41% (53/128) remote: Compressing objects: 42% (54/128) remote: Compressing objects: 43% (56/128) remote: Compressing objects: 44% (57/128) remote: Compressing objects: 45% (58/128) remote: Compressing objects: 46% (59/128) remote: Compressing objects: 47% (61/128) remote: Compressing objects: 48% (62/128) remote: Compressing objects: 49% (63/128) remote: Compressing objects: 50% (64/128) remote: Compressing objects: 51% (66/128) remote: Compressing objects: 52% (67/128) remote: Compressing objects: 53% (68/128) remote: Compressing objects: 54% (70/128) remote: Compressing objects: 55% (71/128) remote: Compressing objects: 56% (72/128) remote: Compressing objects: 57% (73/128) remote: Compressing objects: 58% (75/128) remote: Compressing objects: 59% (76/128) remote: Compressing objects: 60% (77/128) remote: Compressing objects: 61% (79/128) remote: Compressing objects: 62% (80/128) remote: Compressing objects: 63% (81/128) remote: Compressing objects: 64% (82/128) remote: Compressing objects: 65% (84/128) remote: Compressing objects: 66% (85/128) remote: Compressing objects: 67% (86/128) remote: Compressing objects: 68% (88/128) remote: Compressing objects: 69% (89/128) remote: Compressing objects: 70% (90/128) remote: Compressing objects: 71% (91/128) remote: Compressing objects: 72% (93/128) remote: Compressing objects: 73% (94/128) remote: Compressing objects: 74% (95/128) remote: Compressing objects: 75% (96/128) remote: Compressing objects: 76% (98/128) remote: Compressing objects: 77% (99/128) remote: Compressing objects: 78% (100/128) remote: Compressing objects: 79% (102/128) remote: Compressing objects: 80% (103/128) remote: Compressing objects: 81% (104/128) remote: Compressing objects: 82% (105/128) remote: Compressing objects: 83% (107/128) remote: Compressing objects: 84% (108/128) remote: Compressing objects: 85% (109/128) remote: Compressing objects: 86% (111/128) remote: Compressing objects: 87% (112/128) remote: Compressing objects: 88% (113/128) remote: Compressing objects: 89% (114/128) remote: Compressing objects: 90% (116/128) remote: Compressing objects: 91% (117/128) remote: Compressing objects: 92% (118/128) remote: Compressing objects: 93% (120/128) remote: Compressing objects: 94% (121/128) remote: Compressing objects: 95% (122/128) remote: Compressing objects: 96% (123/128) remote: Compressing objects: 97% (125/128) remote: Compressing objects: 98% (126/128) remote: Compressing objects: 99% (127/128) remote: Compressing objects: 100% (128/128) remote: Compressing objects: 100% (128/128), done.
Receiving objects: 0% (1/2541) Receiving objects: 1% (26/2541) Receiving objects: 2% (51/2541) Receiving objects: 3% (77/2541) Receiving objects: 4% (102/2541) Receiving objects: 5% (128/2541) Receiving objects: 6% (153/2541) Receiving objects: 7% (178/2541) Receiving objects: 8% (204/2541) Receiving objects: 9% (229/2541) Receiving objects: 10% (255/2541) Receiving objects: 11% (280/2541) Receiving objects: 12% (305/2541) Receiving objects: 13% (331/2541) Receiving objects: 14% (356/2541) Receiving objects: 15% (382/2541) Receiving objects: 16% (407/2541) Receiving objects: 17% (432/2541) Receiving objects: 18% (458/2541) Receiving objects: 19% (483/2541) Receiving objects: 20% (509/2541) Receiving objects: 21% (534/2541) Receiving objects: 22% (560/2541) Receiving objects: 23% (585/2541) Receiving objects: 24% (610/2541) Receiving objects: 25% (636/2541) Receiving objects: 26% (661/2541) Receiving objects: 27% (687/2541) Receiving objects: 28% (712/2541) Receiving objects: 29% (737/2541) Receiving objects: 30% (763/2541) Receiving objects: 31% (788/2541) Receiving objects: 32% (814/2541) Receiving objects: 33% (839/2541) Receiving objects: 34% (864/2541) Receiving objects: 35% (890/2541) Receiving objects: 36% (915/2541) Receiving objects: 37% (941/2541) Receiving objects: 38% (966/2541) Receiving objects: 39% (991/2541) Receiving objects: 40% (1017/2541) Receiving objects: 41% (1042/2541) Receiving objects: 42% (1068/2541) Receiving objects: 43% (1093/2541) Receiving objects: 44% (1119/2541) Receiving objects: 45% (1144/2541) Receiving objects: 46% (1169/2541) Receiving objects: 47% (1195/2541) Receiving objects: 48% (1220/2541) Receiving objects: 49% (1246/2541) Receiving objects: 50% (1271/2541) Receiving objects: 51% (1296/2541) Receiving objects: 52% (1322/2541) Receiving objects: 53% (1347/2541) Receiving objects: 54% (1373/2541) Receiving objects: 55% (1398/2541) Receiving objects: 56% (1423/2541) Receiving objects: 57% (1449/2541) Receiving objects: 58% (1474/2541) Receiving objects: 59% (1500/2541) Receiving objects: 60% (1525/2541) Receiving objects: 61% (1551/2541) Receiving objects: 62% (1576/2541) Receiving objects: 63% (1601/2541) Receiving objects: 64% (1627/2541) Receiving objects: 65% (1652/2541) Receiving objects: 66% (1678/2541) Receiving objects: 67% (1703/2541) Receiving objects: 68% (1728/2541) Receiving objects: 69% (1754/2541) Receiving objects: 70% (1779/2541) Receiving objects: 71% (1805/2541) Receiving objects: 72% (1830/2541) Receiving objects: 73% (1855/2541) Receiving objects: 74% (1881/2541) Receiving objects: 75% (1906/2541) Receiving objects: 76% (1932/2541) Receiving objects: 77% (1957/2541) Receiving objects: 78% (1982/2541) Receiving objects: 79% (2008/2541) Receiving objects: 80% (2033/2541) Receiving objects: 81% (2059/2541) Receiving objects: 82% (2084/2541) Receiving objects: 83% (2110/2541) Receiving objects: 84% (2135/2541) Receiving objects: 85% (2160/2541) Receiving objects: 86% (2186/2541) Receiving objects: 87% (2211/2541) Receiving objects: 88% (2237/2541) Receiving objects: 89% (2262/2541) Receiving objects: 90% (2287/2541) Receiving objects: 91% (2313/2541) Receiving objects: 92% (2338/2541) Receiving objects: 93% (2364/2541) Receiving objects: 94% (2389/2541) Receiving objects: 95% (2414/2541) remote: Total 2541 (delta 736), reused 688 (delta 688), pack-reused 1685
Receiving objects: 96% (2440/2541) Receiving objects: 97% (2465/2541) Receiving objects: 98% (2491/2541) Receiving objects: 99% (2516/2541) Receiving objects: 100% (2541/2541) Receiving objects: 100% (2541/2541), 421.19 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/1076) Resolving deltas: 2% (29/1076) Resolving deltas: 3% (34/1076) Resolving deltas: 4% (49/1076) Resolving deltas: 5% (55/1076) Resolving deltas: 7% (79/1076) Resolving deltas: 8% (88/1076) Resolving deltas: 9% (98/1076) Resolving deltas: 10% (117/1076) Resolving deltas: 11% (123/1076) Resolving deltas: 13% (149/1076) Resolving deltas: 14% (157/1076) Resolving deltas: 15% (163/1076) Resolving deltas: 16% (178/1076) Resolving deltas: 17% (187/1076) Resolving deltas: 18% (196/1076) Resolving deltas: 19% (209/1076) Resolving deltas: 20% (219/1076) Resolving deltas: 21% (229/1076) Resolving deltas: 22% (237/1076) Resolving deltas: 23% (252/1076) Resolving deltas: 24% (261/1076) Resolving deltas: 25% (269/1076) Resolving deltas: 26% (281/1076) Resolving deltas: 27% (291/1076) Resolving deltas: 28% (302/1076) Resolving deltas: 29% (313/1076) Resolving deltas: 30% (327/1076) Resolving deltas: 31% (334/1076) Resolving deltas: 32% (345/1076) Resolving deltas: 33% (359/1076) Resolving deltas: 34% (367/1076) Resolving deltas: 35% (377/1076) Resolving deltas: 36% (389/1076) Resolving deltas: 37% (405/1076) Resolving deltas: 38% (412/1076) Resolving deltas: 40% (432/1076) Resolving deltas: 41% (445/1076) Resolving deltas: 45% (486/1076) Resolving deltas: 47% (508/1076) Resolving deltas: 48% (517/1076) Resolving deltas: 49% (537/1076) Resolving deltas: 50% (544/1076) Resolving deltas: 51% (552/1076) Resolving deltas: 52% (567/1076) Resolving deltas: 53% (571/1076) Resolving deltas: 54% (582/1076) Resolving deltas: 55% (592/1076) Resolving deltas: 56% (607/1076) Resolving deltas: 57% (614/1076) Resolving deltas: 58% (629/1076) Resolving deltas: 59% (636/1076) Resolving deltas: 60% (646/1076) Resolving deltas: 61% (657/1076) Resolving deltas: 62% (671/1076) Resolving deltas: 63% (678/1076) Resolving deltas: 64% (690/1076) Resolving deltas: 65% (702/1076) Resolving deltas: 66% (714/1076) Resolving deltas: 67% (724/1076) Resolving deltas: 68% (734/1076) Resolving deltas: 69% (743/1076) Resolving deltas: 70% (754/1076) Resolving deltas: 71% (766/1076) Resolving deltas: 72% (775/1076) Resolving deltas: 73% (786/1076) Resolving deltas: 74% (797/1076) Resolving deltas: 75% (807/1076) Resolving deltas: 76% (819/1076) Resolving deltas: 77% (830/1076) Resolving deltas: 78% (842/1076) Resolving deltas: 79% (851/1076) Resolving deltas: 80% (861/1076) Resolving deltas: 81% (873/1076) Resolving deltas: 82% (886/1076) Resolving deltas: 83% (894/1076) Resolving deltas: 84% (906/1076) Resolving deltas: 85% (916/1076) Resolving deltas: 86% (926/1076) Resolving deltas: 87% (937/1076) Resolving deltas: 88% (947/1076) Resolving deltas: 89% (959/1076) Resolving deltas: 90% (969/1076) Resolving deltas: 91% (980/1076) Resolving deltas: 92% (990/1076) Resolving deltas: 93% (1001/1076) Resolving deltas: 94% (1012/1076) Resolving deltas: 95% (1023/1076) Resolving deltas: 96% (1033/1076) Resolving deltas: 97% (1044/1076) Resolving deltas: 98% (1055/1076) Resolving deltas: 99% (1068/1076) Resolving deltas: 100% (1076/1076) Resolving deltas: 100% (1076/1076), completed with 310 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2108/merge: No such file or directory
! ac4c648...8919bd7 refs/pull/2108/merge -> origin/pr/2108/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2138/merge: No such file or directory
! ee5cbae...da065bf refs/pull/2138/merge -> origin/pr/2138/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2174/merge: No such file or directory
! ef18fc3...12dee2f refs/pull/2174/merge -> origin/pr/2174/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2267/merge: No such file or directory
! b2e34c3...d0e4808 refs/pull/2267/merge -> origin/pr/2267/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/head: No such file or directory
! d5a68e5..aebc4f0 refs/pull/2273/head -> origin/pr/2273/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 7214954...40c5d9c refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2294/merge: No such file or directory
! f312586...6342289 refs/pull/2294/merge -> origin/pr/2294/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2301/merge: No such file or directory
! b5dfe19...acbd2f0 refs/pull/2301/merge -> origin/pr/2301/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2311/merge: No such file or directory
! 56fc39b...e20ca2f refs/pull/2311/merge -> origin/pr/2311/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2312/merge: No such file or directory
! 2979e51...1291190 refs/pull/2312/merge -> origin/pr/2312/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2343/merge: No such file or directory
! feba38d...4fe1e17 refs/pull/2343/merge -> origin/pr/2343/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2407/merge: No such file or directory
! c50e0ba...94750e5 refs/pull/2407/merge -> origin/pr/2407/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2411/merge: No such file or directory
! 859dc99...2a9d9fa refs/pull/2411/merge -> origin/pr/2411/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 532346e...87d000f refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
* [new ref] refs/pull/2478/head -> origin/pr/2478/head
* [new ref] refs/pull/2478/merge -> origin/pr/2478/merge
* [new ref] refs/pull/2479/head -> origin/pr/2479/head
* [new ref] refs/pull/2479/merge -> origin/pr/2479/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 713701ddc43c3987e261ecd08b34131ea80c3999 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 713701ddc43c3987e261ecd08b34131ea80c3999
> git rev-list 713701ddc43c3987e261ecd08b34131ea80c3999 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2723391407536229045.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6699621829598040204.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6595153983564103575.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2716071964007673204.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-10 06:02:01,992 9d1e8652 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/9d1e8652/pkb.log
2017-04-10 06:02:01,992 9d1e8652 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-10 06:02:01,993 9d1e8652 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-10 06:02:02,100 9d1e8652 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-10 06:02:02,186 9d1e8652 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-10 06:02:02,199 9d1e8652 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-10 06:02:02,199 9d1e8652 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-10 06:02:02,205 9d1e8652 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-10 06:02:02,247 9d1e8652 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-10 06:02:02,270 9d1e8652 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-10 06:02:02,271 9d1e8652 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/9d1e8652/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #289
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/289/display/redirect?page=changes>
Changes:
[aviemzur] [BEAM-1294] Long running UnboundedSource Readers
[jbonofre] [BEAM-1921] Expose connection properties in JdbcIO
------------------------------------------
[...truncated 245.25 KB...]
! 4e0c9d4...2c40dbc refs/pull/2033/merge -> origin/pr/2033/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 796aa16...a1a6d0a refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! 14a3303...1db71bf refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! c50274b...bdc6681 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2166/merge: No such file or directory
! 4ba2353...8710f00 refs/pull/2166/merge -> origin/pr/2166/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2204/merge: No such file or directory
! 9f75a1f...303a474 refs/pull/2204/merge -> origin/pr/2204/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! 42f3ccd...fa13934 refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! ac7e11c...de74b7c refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2263/merge: No such file or directory
! 366a64c...0d58195b refs/pull/2263/merge -> origin/pr/2263/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! 3dd088a...530f7f1 refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 6884de4...7214954 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2275/merge: No such file or directory
! 77bf99d...735cd94 refs/pull/2275/merge -> origin/pr/2275/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 4c95c1a...1521d3c refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 96215ef...1d3e400 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 10007be...f2dcb59 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! 75500d8...6ed8493 refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! cb42008...785e8c2 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 1cb169a...87a5839 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! f311c97...c73c0b4 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 54530ea...41f60a4 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! d0b3c3a...27d2beb refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 60b3cea...382cd34 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 7317b34...6d079a4 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! c987f51...272146e refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 30b6885...5b1da5f refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 0a61e8a...720cf4e refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 3a04034...11fd22c refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! 0ae27a6...46a033f refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2472/merge: No such file or directory
! 4d60bf2...763eeae refs/pull/2472/merge -> origin/pr/2472/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! 6dff5c4...a77034f refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! d5d8236...a5295e3 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
* [new ref] refs/pull/2477/head -> origin/pr/2477/head
* [new ref] refs/pull/2477/merge -> origin/pr/2477/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 09fe7be...83f830c refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 713701ddc43c3987e261ecd08b34131ea80c3999 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 713701ddc43c3987e261ecd08b34131ea80c3999
> git rev-list a0cfccda4f1fd08ae04aef41c1cc0bc14f00e112 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1601258340537112424.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2619352613179236109.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5524295896537255921.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson592681840033405685.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-10 00:02:06,389 1e3f4cb4 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/1e3f4cb4/pkb.log
2017-04-10 00:02:06,389 1e3f4cb4 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-10 00:02:06,390 1e3f4cb4 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-10 00:02:06,522 1e3f4cb4 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-10 00:02:06,609 1e3f4cb4 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-10 00:02:06,612 1e3f4cb4 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-10 00:02:06,612 1e3f4cb4 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-10 00:02:06,617 1e3f4cb4 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-10 00:02:06,619 1e3f4cb4 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-10 00:02:06,648 1e3f4cb4 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-10 00:02:06,648 1e3f4cb4 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/1e3f4cb4/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #288
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/288/display/redirect>
------------------------------------------
[...truncated 228.91 KB...]
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1488, done.
remote: Compressing objects: 1% (1/61) remote: Compressing objects: 3% (2/61) remote: Compressing objects: 4% (3/61) remote: Compressing objects: 6% (4/61) remote: Compressing objects: 8% (5/61) remote: Compressing objects: 9% (6/61) remote: Compressing objects: 11% (7/61) remote: Compressing objects: 13% (8/61) remote: Compressing objects: 14% (9/61) remote: Compressing objects: 16% (10/61) remote: Compressing objects: 18% (11/61) remote: Compressing objects: 19% (12/61) remote: Compressing objects: 21% (13/61) remote: Compressing objects: 22% (14/61) remote: Compressing objects: 24% (15/61) remote: Compressing objects: 26% (16/61) remote: Compressing objects: 27% (17/61) remote: Compressing objects: 29% (18/61) remote: Compressing objects: 31% (19/61) remote: Compressing objects: 32% (20/61) remote: Compressing objects: 34% (21/61) remote: Compressing objects: 36% (22/61) remote: Compressing objects: 37% (23/61) remote: Compressing objects: 39% (24/61) remote: Compressing objects: 40% (25/61) remote: Compressing objects: 42% (26/61) remote: Compressing objects: 44% (27/61) remote: Compressing objects: 45% (28/61) remote: Compressing objects: 47% (29/61) remote: Compressing objects: 49% (30/61) remote: Compressing objects: 50% (31/61) remote: Compressing objects: 52% (32/61) remote: Compressing objects: 54% (33/61) remote: Compressing objects: 55% (34/61) remote: Compressing objects: 57% (35/61) remote: Compressing objects: 59% (36/61) remote: Compressing objects: 60% (37/61) remote: Compressing objects: 62% (38/61) remote: Compressing objects: 63% (39/61) remote: Compressing objects: 65% (40/61) remote: Compressing objects: 67% (41/61) remote: Compressing objects: 68% (42/61) remote: Compressing objects: 70% (43/61) remote: Compressing objects: 72% (44/61) remote: Compressing objects: 73% (45/61) remote: Compressing objects: 75% (46/61) remote: Compressing objects: 77% (47/61) remote: Compressing objects: 78% (48/61) remote: Compressing objects: 80% (49/61) remote: Compressing objects: 81% (50/61) remote: Compressing objects: 83% (51/61) remote: Compressing objects: 85% (52/61) remote: Compressing objects: 86% (53/61) remote: Compressing objects: 88% (54/61) remote: Compressing objects: 90% (55/61) remote: Compressing objects: 91% (56/61) remote: Compressing objects: 93% (57/61) remote: Compressing objects: 95% (58/61) remote: Compressing objects: 96% (59/61) remote: Compressing objects: 98% (60/61) remote: Compressing objects: 100% (61/61) remote: Compressing objects: 100% (61/61), done.
Receiving objects: 0% (1/1488) Receiving objects: 1% (15/1488) Receiving objects: 2% (30/1488) Receiving objects: 3% (45/1488) Receiving objects: 4% (60/1488) Receiving objects: 5% (75/1488) Receiving objects: 6% (90/1488) Receiving objects: 7% (105/1488) Receiving objects: 8% (120/1488) Receiving objects: 9% (134/1488) Receiving objects: 10% (149/1488) Receiving objects: 11% (164/1488) Receiving objects: 12% (179/1488) Receiving objects: 13% (194/1488) Receiving objects: 14% (209/1488) Receiving objects: 15% (224/1488) Receiving objects: 16% (239/1488) Receiving objects: 17% (253/1488) Receiving objects: 18% (268/1488) Receiving objects: 19% (283/1488) Receiving objects: 20% (298/1488) Receiving objects: 21% (313/1488) Receiving objects: 22% (328/1488) Receiving objects: 23% (343/1488) Receiving objects: 24% (358/1488) Receiving objects: 25% (372/1488) Receiving objects: 26% (387/1488) Receiving objects: 27% (402/1488) Receiving objects: 28% (417/1488) Receiving objects: 29% (432/1488) Receiving objects: 30% (447/1488) Receiving objects: 31% (462/1488) Receiving objects: 32% (477/1488) Receiving objects: 33% (492/1488) Receiving objects: 34% (506/1488) Receiving objects: 35% (521/1488) Receiving objects: 36% (536/1488) Receiving objects: 37% (551/1488) Receiving objects: 38% (566/1488) Receiving objects: 39% (581/1488) Receiving objects: 40% (596/1488) Receiving objects: 41% (611/1488) Receiving objects: 42% (625/1488) Receiving objects: 43% (640/1488) Receiving objects: 44% (655/1488) Receiving objects: 45% (670/1488) Receiving objects: 46% (685/1488) Receiving objects: 47% (700/1488) Receiving objects: 48% (715/1488) Receiving objects: 49% (730/1488) Receiving objects: 50% (744/1488) Receiving objects: 51% (759/1488) Receiving objects: 52% (774/1488) Receiving objects: 53% (789/1488) Receiving objects: 54% (804/1488) Receiving objects: 55% (819/1488) Receiving objects: 56% (834/1488) Receiving objects: 57% (849/1488) Receiving objects: 58% (864/1488) Receiving objects: 59% (878/1488) Receiving objects: 60% (893/1488) Receiving objects: 61% (908/1488) Receiving objects: 62% (923/1488) Receiving objects: 63% (938/1488) Receiving objects: 64% (953/1488) Receiving objects: 65% (968/1488) Receiving objects: 66% (983/1488) Receiving objects: 67% (997/1488) Receiving objects: 68% (1012/1488) Receiving objects: 69% (1027/1488) Receiving objects: 70% (1042/1488) Receiving objects: 71% (1057/1488) Receiving objects: 72% (1072/1488) Receiving objects: 73% (1087/1488) Receiving objects: 74% (1102/1488) Receiving objects: 75% (1116/1488) Receiving objects: 76% (1131/1488) Receiving objects: 77% (1146/1488) Receiving objects: 78% (1161/1488) Receiving objects: 79% (1176/1488) Receiving objects: 80% (1191/1488) Receiving objects: 81% (1206/1488) Receiving objects: 82% (1221/1488) Receiving objects: 83% (1236/1488) Receiving objects: 84% (1250/1488) Receiving objects: 85% (1265/1488) Receiving objects: 86% (1280/1488) Receiving objects: 87% (1295/1488) Receiving objects: 88% (1310/1488) Receiving objects: 89% (1325/1488) Receiving objects: 90% (1340/1488) Receiving objects: 91% (1355/1488) Receiving objects: 92% (1369/1488) Receiving objects: 93% (1384/1488) Receiving objects: 94% (1399/1488) Receiving objects: 95% (1414/1488) remote: Total 1488 (delta 564), reused 532 (delta 532), pack-reused 871
Receiving objects: 96% (1429/1488) Receiving objects: 97% (1444/1488) Receiving objects: 98% (1459/1488) Receiving objects: 99% (1474/1488) Receiving objects: 100% (1488/1488) Receiving objects: 100% (1488/1488), 198.10 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/582) Resolving deltas: 1% (7/582) Resolving deltas: 2% (12/582) Resolving deltas: 3% (20/582) Resolving deltas: 4% (25/582) Resolving deltas: 5% (31/582) Resolving deltas: 6% (37/582) Resolving deltas: 8% (49/582) Resolving deltas: 9% (53/582) Resolving deltas: 11% (66/582) Resolving deltas: 12% (70/582) Resolving deltas: 13% (76/582) Resolving deltas: 14% (84/582) Resolving deltas: 15% (90/582) Resolving deltas: 16% (94/582) Resolving deltas: 17% (101/582) Resolving deltas: 19% (114/582) Resolving deltas: 20% (120/582) Resolving deltas: 25% (151/582) Resolving deltas: 26% (152/582) Resolving deltas: 28% (163/582) Resolving deltas: 29% (170/582) Resolving deltas: 30% (178/582) Resolving deltas: 31% (186/582) Resolving deltas: 33% (193/582) Resolving deltas: 34% (198/582) Resolving deltas: 35% (204/582) Resolving deltas: 36% (210/582) Resolving deltas: 37% (217/582) Resolving deltas: 38% (224/582) Resolving deltas: 39% (227/582) Resolving deltas: 40% (233/582) Resolving deltas: 41% (240/582) Resolving deltas: 42% (247/582) Resolving deltas: 43% (251/582) Resolving deltas: 44% (260/582) Resolving deltas: 45% (266/582) Resolving deltas: 46% (271/582) Resolving deltas: 47% (275/582) Resolving deltas: 48% (282/582) Resolving deltas: 49% (287/582) Resolving deltas: 50% (291/582) Resolving deltas: 51% (298/582) Resolving deltas: 53% (309/582) Resolving deltas: 55% (324/582) Resolving deltas: 57% (332/582) Resolving deltas: 58% (340/582) Resolving deltas: 59% (344/582) Resolving deltas: 60% (350/582) Resolving deltas: 61% (356/582) Resolving deltas: 62% (364/582) Resolving deltas: 63% (367/582) Resolving deltas: 64% (373/582) Resolving deltas: 65% (379/582) Resolving deltas: 66% (385/582) Resolving deltas: 67% (390/582) Resolving deltas: 68% (397/582) Resolving deltas: 69% (403/582) Resolving deltas: 70% (408/582) Resolving deltas: 71% (416/582) Resolving deltas: 72% (421/582) Resolving deltas: 73% (425/582) Resolving deltas: 74% (432/582) Resolving deltas: 75% (437/582) Resolving deltas: 76% (443/582) Resolving deltas: 77% (449/582) Resolving deltas: 78% (454/582) Resolving deltas: 79% (460/582) Resolving deltas: 80% (466/582) Resolving deltas: 81% (472/582) Resolving deltas: 82% (478/582) Resolving deltas: 83% (484/582) Resolving deltas: 84% (491/582) Resolving deltas: 85% (497/582) Resolving deltas: 86% (501/582) Resolving deltas: 87% (507/582) Resolving deltas: 88% (513/582) Resolving deltas: 89% (518/582) Resolving deltas: 90% (525/582) Resolving deltas: 91% (530/582) Resolving deltas: 92% (536/582) Resolving deltas: 93% (542/582) Resolving deltas: 94% (548/582) Resolving deltas: 95% (553/582) Resolving deltas: 96% (559/582) Resolving deltas: 97% (566/582) Resolving deltas: 98% (572/582) Resolving deltas: 99% (577/582) Resolving deltas: 100% (582/582) Resolving deltas: 100% (582/582), completed with 265 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2033/head: No such file or directory
! c8896e0..0b70a3f refs/pull/2033/head -> origin/pr/2033/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2033/merge: No such file or directory
! 05b742f...4e0c9d4 refs/pull/2033/merge -> origin/pr/2033/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
* [new ref] refs/pull/2476/head -> origin/pr/2476/head
* [new ref] refs/pull/2476/merge -> origin/pr/2476/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a0cfccda4f1fd08ae04aef41c1cc0bc14f00e112 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a0cfccda4f1fd08ae04aef41c1cc0bc14f00e112
> git rev-list a0cfccda4f1fd08ae04aef41c1cc0bc14f00e112 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3935218205589833958.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson343451791577248523.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3250045475934430709.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7183435041788206298.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-09 18:01:58,173 47a8b405 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/47a8b405/pkb.log
2017-04-09 18:01:58,173 47a8b405 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-09 18:01:58,174 47a8b405 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-09 18:01:58,373 47a8b405 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-09 18:01:58,464 47a8b405 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-09 18:01:58,467 47a8b405 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-09 18:01:58,467 47a8b405 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-09 18:01:58,473 47a8b405 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-09 18:01:58,475 47a8b405 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-09 18:01:58,502 47a8b405 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-09 18:01:58,503 47a8b405 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/47a8b405/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #287
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/287/display/redirect?page=changes>
Changes:
[amitsela33] [BEAM-1737] Implement a Single-output ParDo as a Multi-output ParDo with
------------------------------------------
[...truncated 245.05 KB...]
! 40858af...437487e refs/pull/1851/merge -> origin/pr/1851/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2033/merge: No such file or directory
! e0496ef...05b742f refs/pull/2033/merge -> origin/pr/2033/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! 9ccc8df...796aa16 refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2093/merge: No such file or directory
! 62211ac...a81278c refs/pull/2093/merge -> origin/pr/2093/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! d9b5625...14a3303 refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! 3b1488f...c50274b refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2166/merge: No such file or directory
! 45a939f...4ba2353 refs/pull/2166/merge -> origin/pr/2166/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2204/merge: No such file or directory
! 511b015...9f75a1f refs/pull/2204/merge -> origin/pr/2204/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! bbbaf62...42f3ccd refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! e12dbc7...ac7e11c refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2263/merge: No such file or directory
! aabf077...366a64c refs/pull/2263/merge -> origin/pr/2263/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! 9bf6436...3dd088a refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! a5c366a...6884de4 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! d936aa7...4c95c1a refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! a698a71...96215ef refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 031c471...10007be refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! 6119a35...75500d8 refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! f2b22c2...cb42008 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 2af764c...1cb169a refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 1a6b3cd...f311c97 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 157a9c5...54530ea refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 855ebc6...d0b3c3a refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 889bad2...60b3cea refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! ea1995c...7317b34 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2420/merge: No such file or directory
! 5347532...1bea85f refs/pull/2420/merge -> origin/pr/2420/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 3780e52...c987f51 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 8a6438c...30b6885 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! e029cce...0a61e8a refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 5e8e429...3a04034 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/2471/merge: No such file or directory
! ced0940...0ae27a6 refs/pull/2471/merge -> origin/pr/2471/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2472/merge: No such file or directory
! c92bc59...4d60bf2 refs/pull/2472/merge -> origin/pr/2472/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2473/merge: No such file or directory
! 00a5585...6dff5c4 refs/pull/2473/merge -> origin/pr/2473/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2474/merge: No such file or directory
! 25ce49d...d5d8236 refs/pull/2474/merge -> origin/pr/2474/merge (unable to update local ref)
* [new ref] refs/pull/2475/head -> origin/pr/2475/head
* [new ref] refs/pull/2475/merge -> origin/pr/2475/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! abf0003...09fe7be refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a0cfccda4f1fd08ae04aef41c1cc0bc14f00e112 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a0cfccda4f1fd08ae04aef41c1cc0bc14f00e112
> git rev-list 810db7f990a9e39179f3613347ab5cde7e7c650c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9083828710732689143.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5807787851388684744.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5429933585592818141.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4504895539002620133.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-09 12:02:03,957 5e644971 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/5e644971/pkb.log
2017-04-09 12:02:03,957 5e644971 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-09 12:02:03,958 5e644971 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-09 12:02:04,171 5e644971 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-09 12:02:04,271 5e644971 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-09 12:02:04,273 5e644971 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-09 12:02:04,274 5e644971 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-09 12:02:04,280 5e644971 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-09 12:02:04,282 5e644971 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-09 12:02:04,305 5e644971 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-09 12:02:04,306 5e644971 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/5e644971/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #286
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/286/display/redirect>
------------------------------------------
[...truncated 249.00 KB...]
! aaf02a7...da67322 refs/pull/1925/merge -> origin/pr/1925/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2009/merge: No such file or directory
! 10abae8...ea29773 refs/pull/2009/merge -> origin/pr/2009/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2069/merge: No such file or directory
! 9fbdc6f...46fd721 refs/pull/2069/merge -> origin/pr/2069/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2099/merge: No such file or directory
! e751d67...a6eeb60 refs/pull/2099/merge -> origin/pr/2099/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2110/merge: No such file or directory
! 7fc9e69...9767628 refs/pull/2110/merge -> origin/pr/2110/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2137/merge: No such file or directory
! 4adc08e...1a85857 refs/pull/2137/merge -> origin/pr/2137/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2169/merge: No such file or directory
! 6841376...61faa9a refs/pull/2169/merge -> origin/pr/2169/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2174/merge: No such file or directory
! b7474f1...ef18fc3 refs/pull/2174/merge -> origin/pr/2174/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2175/merge: No such file or directory
! f1f7865...a88e3df refs/pull/2175/merge -> origin/pr/2175/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2176/merge: No such file or directory
! 4eae45a...7f2dd61 refs/pull/2176/merge -> origin/pr/2176/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2179/merge: No such file or directory
! cff837e...d2f0ca9 refs/pull/2179/merge -> origin/pr/2179/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2195/merge: No such file or directory
! 8d4913b...f2859e1 refs/pull/2195/merge -> origin/pr/2195/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2227/merge: No such file or directory
! c3c991c...e15e874 refs/pull/2227/merge -> origin/pr/2227/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2236/merge: No such file or directory
! a6cc28a...e9dac14 refs/pull/2236/merge -> origin/pr/2236/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2249/merge: No such file or directory
! 51dbdeb...fe73128 refs/pull/2249/merge -> origin/pr/2249/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2256/merge: No such file or directory
! db9b993...8eca896 refs/pull/2256/merge -> origin/pr/2256/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2261/merge: No such file or directory
! 5a4271d...b3a80ae refs/pull/2261/merge -> origin/pr/2261/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2267/merge: No such file or directory
! c6eaaa1...b2e34c3 refs/pull/2267/merge -> origin/pr/2267/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2301/merge: No such file or directory
! ff680b3...b5dfe19 refs/pull/2301/merge -> origin/pr/2301/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2303/merge: No such file or directory
! 29d1858...ad6c0dc refs/pull/2303/merge -> origin/pr/2303/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2315/merge: No such file or directory
! e6d168f...67f684a refs/pull/2315/merge -> origin/pr/2315/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2316/merge: No such file or directory
! b2db5cb...fc0d1a7 refs/pull/2316/merge -> origin/pr/2316/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2326/merge: No such file or directory
! a5e2248...950055f refs/pull/2326/merge -> origin/pr/2326/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2352/merge: No such file or directory
! 585df37...11fa6a0 refs/pull/2352/merge -> origin/pr/2352/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/238/merge: No such file or directory
! 761dff3...3075dc1 refs/pull/238/merge -> origin/pr/238/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/head: No such file or directory
! 52cae72...3b30027 refs/pull/2401/head -> origin/pr/2401/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 5f6e281...855ebc6 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/head: No such file or directory
! 54832dd...a078017 refs/pull/2406/head -> origin/pr/2406/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! fb9d9df...889bad2 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 5b63a5a...fb3db3b refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 5293678...532346e refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/278/merge: No such file or directory
! 319114d...4c5e015 refs/pull/278/merge -> origin/pr/278/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/288/merge: No such file or directory
! a0f9042...19675f4 refs/pull/288/merge -> origin/pr/288/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/314/merge: No such file or directory
! 0fdd146...049852e refs/pull/314/merge -> origin/pr/314/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/455/merge: No such file or directory
! 54d38cf...895dfbd refs/pull/455/merge -> origin/pr/455/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 810db7f990a9e39179f3613347ab5cde7e7c650c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 810db7f990a9e39179f3613347ab5cde7e7c650c
> git rev-list 810db7f990a9e39179f3613347ab5cde7e7c650c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3276017892654249207.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2118528424598321312.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7917897183257555327.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4305511337543752093.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-09 06:01:57,785 54ae8d71 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/54ae8d71/pkb.log
2017-04-09 06:01:57,785 54ae8d71 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-09 06:01:57,786 54ae8d71 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-09 06:01:57,982 54ae8d71 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-09 06:01:58,074 54ae8d71 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-09 06:01:58,076 54ae8d71 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-09 06:01:58,076 54ae8d71 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-09 06:01:58,083 54ae8d71 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-09 06:01:58,085 54ae8d71 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-09 06:01:58,108 54ae8d71 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-09 06:01:58,108 54ae8d71 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/54ae8d71/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #285
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/285/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 810db7f990a9e39179f3613347ab5cde7e7c650c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 810db7f990a9e39179f3613347ab5cde7e7c650c
> git rev-list 810db7f990a9e39179f3613347ab5cde7e7c650c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson333320385556229445.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5298679308216121185.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2262213367882751159.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3785185009729583037.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-09 00:00:18,250 2ba258a7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/2ba258a7/pkb.log
2017-04-09 00:00:18,250 2ba258a7 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-09 00:00:18,250 2ba258a7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-09 00:00:18,456 2ba258a7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-09 00:00:18,542 2ba258a7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-09 00:00:18,545 2ba258a7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-09 00:00:18,545 2ba258a7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-09 00:00:18,551 2ba258a7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-09 00:00:18,553 2ba258a7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-09 00:00:18,577 2ba258a7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-09 00:00:18,577 2ba258a7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/2ba258a7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #284
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/284/display/redirect>
------------------------------------------
[...truncated 279.53 KB...]
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 810db7f990a9e39179f3613347ab5cde7e7c650c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 810db7f990a9e39179f3613347ab5cde7e7c650c
> git rev-list 810db7f990a9e39179f3613347ab5cde7e7c650c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1338064616377206910.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8023822062702922179.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1999132628496994679.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4658131203392392016.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-08 18:02:03,529 6ec00ec3 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/6ec00ec3/pkb.log
2017-04-08 18:02:03,530 6ec00ec3 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-08 18:02:03,530 6ec00ec3 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-08 18:02:03,681 6ec00ec3 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-08 18:02:03,803 6ec00ec3 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-08 18:02:03,807 6ec00ec3 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-08 18:02:03,808 6ec00ec3 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-08 18:02:03,816 6ec00ec3 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-08 18:02:03,819 6ec00ec3 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-08 18:02:03,838 6ec00ec3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-08 18:02:03,839 6ec00ec3 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/6ec00ec3/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #283
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/283/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 810db7f990a9e39179f3613347ab5cde7e7c650c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 810db7f990a9e39179f3613347ab5cde7e7c650c
> git rev-list 810db7f990a9e39179f3613347ab5cde7e7c650c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5842244455260452177.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2400829515948972300.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8954000814760055258.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson446858649772978620.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-08 12:01:40,994 26ea60d1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/26ea60d1/pkb.log
2017-04-08 12:01:40,994 26ea60d1 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-08 12:01:40,994 26ea60d1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-08 12:01:41,157 26ea60d1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-08 12:01:41,243 26ea60d1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-08 12:01:41,246 26ea60d1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-08 12:01:41,246 26ea60d1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-08 12:01:41,252 26ea60d1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-08 12:01:41,254 26ea60d1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-08 12:01:41,278 26ea60d1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-08 12:01:41,278 26ea60d1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/26ea60d1/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #282
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/282/display/redirect?page=changes>
Changes:
[kirpichov] Clarifies doc of ProcessElement re: HasDefaultTracker
[kirpichov] Fixes SDF issues re: watermarks and stop/resume
[kirpichov] Adds tests for the watermark hold (previously untested)
[kirpichov] BEAM-1887 Switch Apex ParDo to new DoFn.
[dhalperi] TestDataflowRunner: better error handling
[thw] Fix for potentially unclosed streams in ApexYarnLauncher
------------------------------------------
[...truncated 247.05 KB...]
! 1b3451d...511b015 refs/pull/2204/merge -> origin/pr/2204/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! cfc81bd...bbbaf62 refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! ff6f15e...e12dbc7 refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2225/merge: No such file or directory
! f06657a...86235c4 refs/pull/2225/merge -> origin/pr/2225/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2236/merge: No such file or directory
! 2811b65...a6cc28a refs/pull/2236/merge -> origin/pr/2236/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2260/merge: No such file or directory
! d1dd5b6...8a2a5a1 refs/pull/2260/merge -> origin/pr/2260/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2263/merge: No such file or directory
! 2c8c125...aabf077 refs/pull/2263/merge -> origin/pr/2263/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! a21dd65...9bf6436 refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 7b78200...a5c366a refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 2157480...d936aa7 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 6cf0b37...a698a71 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 1d6667c...031c471 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! 8ff74ba...6119a35 refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! f8961ab...f2b22c2 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2342/merge: No such file or directory
! 3c995b9...923ad67 refs/pull/2342/merge -> origin/pr/2342/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 2cde7d1...2af764c refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2352/merge: No such file or directory
! 7912fab...585df37 refs/pull/2352/merge -> origin/pr/2352/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! b51cdf5...1a6b3cd refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! d7f64d6...157a9c5 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 83332c3...5e54b6a refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2376/merge: No such file or directory
! c0a868a...a48e367 refs/pull/2376/merge -> origin/pr/2376/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! e5406b6...3caf915 refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 2f5e852...ab591fc refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 9b28c1c...5f6e281 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 377cda9...fb9d9df refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2409/merge: No such file or directory
! 2287b56...3b743c1 refs/pull/2409/merge -> origin/pr/2409/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! f25dc1f...ea1995c refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2420/merge: No such file or directory
! c5fb4de...5347532 refs/pull/2420/merge -> origin/pr/2420/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! eea3448...3780e52 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 8f0de3c...8a6438c refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 2d272e0...e029cce refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! 53b8129...1daa0d2 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 51a06a4...5e8e429 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 3500971...5293678 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
* [new ref] refs/pull/2467/head -> origin/pr/2467/head
* [new ref] refs/pull/2467/merge -> origin/pr/2467/merge
* [new ref] refs/pull/2468/head -> origin/pr/2468/head
* [new ref] refs/pull/2468/merge -> origin/pr/2468/merge
* [new ref] refs/pull/2469/head -> origin/pr/2469/head
* [new ref] refs/pull/2470/head -> origin/pr/2470/head
* [new ref] refs/pull/2470/merge -> origin/pr/2470/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 9cb6c61...abf0003 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 810db7f990a9e39179f3613347ab5cde7e7c650c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 810db7f990a9e39179f3613347ab5cde7e7c650c
> git rev-list 4a694cebb5deaf4f0d24bea18fa2194798a8ac0f # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6417282676418667128.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3529015901170592300.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7763300202285901961.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7743823358270797324.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-08 06:01:56,129 94c5fd9c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/94c5fd9c/pkb.log
2017-04-08 06:01:56,129 94c5fd9c MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-08 06:01:56,130 94c5fd9c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-08 06:01:56,396 94c5fd9c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-08 06:01:56,531 94c5fd9c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-08 06:01:56,533 94c5fd9c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-08 06:01:56,534 94c5fd9c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-08 06:01:56,538 94c5fd9c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-08 06:01:56,540 94c5fd9c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-08 06:01:56,556 94c5fd9c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-08 06:01:56,557 94c5fd9c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/94c5fd9c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #281
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/281/display/redirect?page=changes>
Changes:
[chamikara] [BEAM-778] Fix the Compressed file seek tests on windows
[altay] Clean up in textio and tfrecordio
[altay] [BEAM-1823] Improve ValidatesRunner Test Log
[kirpichov] Cleanup: removes two unused constants
[kirpichov] [BEAM-65] Adds HasDefaultTracker for RestrictionTracker inference
------------------------------------------
[...truncated 258.11 KB...]
! 97b399d...6cbfbdf refs/pull/2351/merge -> origin/pr/2351/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2352/merge: No such file or directory
! 996819f...7912fab refs/pull/2352/merge -> origin/pr/2352/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! f93ad98...b51cdf5 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2362/merge: No such file or directory
! 5a5679e...81ead05 refs/pull/2362/merge -> origin/pr/2362/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 9e50ba9...d7f64d6 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 33f4b2c...83332c3 refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2375/merge: No such file or directory
! 579a3ed...af8dd5b refs/pull/2375/merge -> origin/pr/2375/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! 72bda66...b642536 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 11d5ff0...836c0be refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2390/merge: No such file or directory
! c46c152...2c67095 refs/pull/2390/merge -> origin/pr/2390/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! e5b3a01...a88e02a refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/merge: No such file or directory
! 146853b...3b6313f refs/pull/2393/merge -> origin/pr/2393/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 27afb8d...2f5e852 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! 423d213...e498e4b refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! 73e087b...6a1ee14 refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 83bfc3b...9b28c1c refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! de0f48f...377cda9 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2407/merge: No such file or directory
! 39572fd...c50e0ba refs/pull/2407/merge -> origin/pr/2407/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 40e1cd4...a3e4c50 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2412/merge: No such file or directory
! 4ada4ab...2800ff1 refs/pull/2412/merge -> origin/pr/2412/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 53ddaa8...5b63a5a refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 6512d97...f25dc1f refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2418/merge: No such file or directory
! af5437d...7ce75ea refs/pull/2418/merge -> origin/pr/2418/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2419/merge: No such file or directory
! 8db8537...6df2925 refs/pull/2419/merge -> origin/pr/2419/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2420/merge: No such file or directory
! 9cd4737...c5fb4de refs/pull/2420/merge -> origin/pr/2420/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 2d39b03...eea3448 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! 3c19c57..7ae9488 refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 52052dd...8f0de3c refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2424/merge: No such file or directory
! 89b077a...31e480e refs/pull/2424/merge -> origin/pr/2424/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! ffe6fb1...2d272e0 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2427/merge: No such file or directory
! c54a4e5...4586537 refs/pull/2427/merge -> origin/pr/2427/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! cbedaef...04ed031 refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! ab72049...53b8129 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 9b409ac...51a06a4 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! fc8dcc1...f1831b8 refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2433/merge: No such file or directory
! 07a20bd...fb31fc9 refs/pull/2433/merge -> origin/pr/2433/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! bf0f4e6...3500971 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2455/merge -> origin/pr/2455/merge
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
* [new ref] refs/pull/2459/head -> origin/pr/2459/head
* [new ref] refs/pull/2459/merge -> origin/pr/2459/merge
* [new ref] refs/pull/2460/head -> origin/pr/2460/head
* [new ref] refs/pull/2461/head -> origin/pr/2461/head
* [new ref] refs/pull/2461/merge -> origin/pr/2461/merge
* [new ref] refs/pull/2462/head -> origin/pr/2462/head
* [new ref] refs/pull/2462/merge -> origin/pr/2462/merge
* [new ref] refs/pull/2463/head -> origin/pr/2463/head
* [new ref] refs/pull/2463/merge -> origin/pr/2463/merge
* [new ref] refs/pull/2464/head -> origin/pr/2464/head
* [new ref] refs/pull/2464/merge -> origin/pr/2464/merge
* [new ref] refs/pull/2465/head -> origin/pr/2465/head
* [new ref] refs/pull/2465/merge -> origin/pr/2465/merge
* [new ref] refs/pull/2466/head -> origin/pr/2466/head
* [new ref] refs/pull/2466/merge -> origin/pr/2466/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 1885e31...9cb6c61 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4a694cebb5deaf4f0d24bea18fa2194798a8ac0f (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4a694cebb5deaf4f0d24bea18fa2194798a8ac0f
> git rev-list 661c06652da5d853904a74c5313ae978a29a60b7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7468522010329839792.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5325785414600737327.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2258165572997967685.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8233198732083635265.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-08 00:02:13,965 0ee90579 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/0ee90579/pkb.log
2017-04-08 00:02:13,966 0ee90579 MainThread INFO PerfKitBenchmarker version: v1.11.0-36-g7a79811
2017-04-08 00:02:13,966 0ee90579 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-08 00:02:14,336 0ee90579 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-08 00:02:14,419 0ee90579 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-08 00:02:14,421 0ee90579 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-08 00:02:14,421 0ee90579 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-08 00:02:14,426 0ee90579 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-08 00:02:14,428 0ee90579 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-08 00:02:14,456 0ee90579 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-08 00:02:14,457 0ee90579 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/0ee90579/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #280
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/280/display/redirect?page=changes>
Changes:
[davor] BEAM-1851: Update documentation for for fixedSizeGlobally to be clear
[altay] Use absolute import for dataflow iobase test.
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 661c06652da5d853904a74c5313ae978a29a60b7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 661c06652da5d853904a74c5313ae978a29a60b7
> git rev-list a8edbb81f340578966400d106297c1732ca3b7fd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7036526954124360342.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3526700484966669764.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2779541195002170604.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson392642360048928517.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-07 18:00:25,715 311231e1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/311231e1/pkb.log
2017-04-07 18:00:25,715 311231e1 MainThread INFO PerfKitBenchmarker version: v1.11.0-35-g0f7ba26
2017-04-07 18:00:25,716 311231e1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-07 18:00:26,187 311231e1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-07 18:00:26,322 311231e1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-07 18:00:26,325 311231e1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-07 18:00:26,325 311231e1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-07 18:00:26,330 311231e1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-07 18:00:26,334 311231e1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-07 18:00:26,348 311231e1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-07 18:00:26,349 311231e1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/311231e1/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #279
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/279/display/redirect>
------------------------------------------
[...truncated 227.05 KB...]
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1283, done.
remote: Compressing objects: 1% (1/60) remote: Compressing objects: 3% (2/60) remote: Compressing objects: 5% (3/60) remote: Compressing objects: 6% (4/60) remote: Compressing objects: 8% (5/60) remote: Compressing objects: 10% (6/60) remote: Compressing objects: 11% (7/60) remote: Compressing objects: 13% (8/60) remote: Compressing objects: 15% (9/60) remote: Compressing objects: 16% (10/60) remote: Compressing objects: 18% (11/60) remote: Compressing objects: 20% (12/60) remote: Compressing objects: 21% (13/60) remote: Compressing objects: 23% (14/60) remote: Compressing objects: 25% (15/60) remote: Compressing objects: 26% (16/60) remote: Compressing objects: 28% (17/60) remote: Compressing objects: 30% (18/60) remote: Compressing objects: 31% (19/60) remote: Compressing objects: 33% (20/60) remote: Compressing objects: 35% (21/60) remote: Compressing objects: 36% (22/60) remote: Compressing objects: 38% (23/60) remote: Compressing objects: 40% (24/60) remote: Compressing objects: 41% (25/60) remote: Compressing objects: 43% (26/60) remote: Compressing objects: 45% (27/60) remote: Compressing objects: 46% (28/60) remote: Compressing objects: 48% (29/60) remote: Compressing objects: 50% (30/60) remote: Compressing objects: 51% (31/60) remote: Compressing objects: 53% (32/60) remote: Compressing objects: 55% (33/60) remote: Compressing objects: 56% (34/60) remote: Compressing objects: 58% (35/60) remote: Compressing objects: 60% (36/60) remote: Compressing objects: 61% (37/60) remote: Compressing objects: 63% (38/60) remote: Compressing objects: 65% (39/60) remote: Compressing objects: 66% (40/60) remote: Compressing objects: 68% (41/60) remote: Compressing objects: 70% (42/60) remote: Compressing objects: 71% (43/60) remote: Compressing objects: 73% (44/60) remote: Compressing objects: 75% (45/60) remote: Compressing objects: 76% (46/60) remote: Compressing objects: 78% (47/60) remote: Compressing objects: 80% (48/60) remote: Compressing objects: 81% (49/60) remote: Compressing objects: 83% (50/60) remote: Compressing objects: 85% (51/60) remote: Compressing objects: 86% (52/60) remote: Compressing objects: 88% (53/60) remote: Compressing objects: 90% (54/60) remote: Compressing objects: 91% (55/60) remote: Compressing objects: 93% (56/60) remote: Compressing objects: 95% (57/60) remote: Compressing objects: 96% (58/60) remote: Compressing objects: 98% (59/60) remote: Compressing objects: 100% (60/60) remote: Compressing objects: 100% (60/60), done.
Receiving objects: 0% (1/1283) Receiving objects: 1% (13/1283) Receiving objects: 2% (26/1283) Receiving objects: 3% (39/1283) Receiving objects: 4% (52/1283) Receiving objects: 5% (65/1283) Receiving objects: 6% (77/1283) Receiving objects: 7% (90/1283) Receiving objects: 8% (103/1283) Receiving objects: 9% (116/1283) Receiving objects: 10% (129/1283) Receiving objects: 11% (142/1283) Receiving objects: 12% (154/1283) Receiving objects: 13% (167/1283) Receiving objects: 14% (180/1283) Receiving objects: 15% (193/1283) Receiving objects: 16% (206/1283) Receiving objects: 17% (219/1283) Receiving objects: 18% (231/1283) Receiving objects: 19% (244/1283) Receiving objects: 20% (257/1283) Receiving objects: 21% (270/1283) Receiving objects: 22% (283/1283) Receiving objects: 23% (296/1283) Receiving objects: 24% (308/1283) Receiving objects: 25% (321/1283) Receiving objects: 26% (334/1283) Receiving objects: 27% (347/1283) Receiving objects: 28% (360/1283) Receiving objects: 29% (373/1283) Receiving objects: 30% (385/1283) Receiving objects: 31% (398/1283) Receiving objects: 32% (411/1283) Receiving objects: 33% (424/1283) Receiving objects: 34% (437/1283) Receiving objects: 35% (450/1283) Receiving objects: 36% (462/1283) Receiving objects: 37% (475/1283) Receiving objects: 38% (488/1283) Receiving objects: 39% (501/1283) Receiving objects: 40% (514/1283) Receiving objects: 41% (527/1283) Receiving objects: 42% (539/1283) Receiving objects: 43% (552/1283) Receiving objects: 44% (565/1283) Receiving objects: 45% (578/1283) Receiving objects: 46% (591/1283) Receiving objects: 47% (604/1283) Receiving objects: 48% (616/1283) Receiving objects: 49% (629/1283) Receiving objects: 50% (642/1283) Receiving objects: 51% (655/1283) Receiving objects: 52% (668/1283) Receiving objects: 53% (680/1283) Receiving objects: 54% (693/1283) Receiving objects: 55% (706/1283) Receiving objects: 56% (719/1283) Receiving objects: 57% (732/1283) Receiving objects: 58% (745/1283) Receiving objects: 59% (757/1283) Receiving objects: 60% (770/1283) Receiving objects: 61% (783/1283) Receiving objects: 62% (796/1283) Receiving objects: 63% (809/1283) Receiving objects: 64% (822/1283) Receiving objects: 65% (834/1283) Receiving objects: 66% (847/1283) Receiving objects: 67% (860/1283) Receiving objects: 68% (873/1283) Receiving objects: 69% (886/1283) Receiving objects: 70% (899/1283) Receiving objects: 71% (911/1283) Receiving objects: 72% (924/1283) Receiving objects: 73% (937/1283) Receiving objects: 74% (950/1283) Receiving objects: 75% (963/1283) Receiving objects: 76% (976/1283) Receiving objects: 77% (988/1283) Receiving objects: 78% (1001/1283) Receiving objects: 79% (1014/1283) Receiving objects: 80% (1027/1283) remote: Total 1283 (delta 448), reused 425 (delta 425), pack-reused 741
Receiving objects: 81% (1040/1283) Receiving objects: 82% (1053/1283) Receiving objects: 83% (1065/1283) Receiving objects: 84% (1078/1283) Receiving objects: 85% (1091/1283) Receiving objects: 86% (1104/1283) Receiving objects: 87% (1117/1283) Receiving objects: 88% (1130/1283) Receiving objects: 89% (1142/1283) Receiving objects: 90% (1155/1283) Receiving objects: 91% (1168/1283) Receiving objects: 92% (1181/1283) Receiving objects: 93% (1194/1283) Receiving objects: 94% (1207/1283) Receiving objects: 95% (1219/1283) Receiving objects: 96% (1232/1283) Receiving objects: 97% (1245/1283) Receiving objects: 98% (1258/1283) Receiving objects: 99% (1271/1283) Receiving objects: 100% (1283/1283) Receiving objects: 100% (1283/1283), 179.27 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/466) Resolving deltas: 1% (5/466) Resolving deltas: 2% (12/466) Resolving deltas: 3% (14/466) Resolving deltas: 4% (21/466) Resolving deltas: 5% (24/466) Resolving deltas: 6% (30/466) Resolving deltas: 7% (36/466) Resolving deltas: 8% (38/466) Resolving deltas: 9% (42/466) Resolving deltas: 11% (53/466) Resolving deltas: 12% (59/466) Resolving deltas: 13% (63/466) Resolving deltas: 14% (66/466) Resolving deltas: 15% (70/466) Resolving deltas: 16% (78/466) Resolving deltas: 20% (95/466) Resolving deltas: 21% (100/466) Resolving deltas: 22% (105/466) Resolving deltas: 23% (109/466) Resolving deltas: 24% (112/466) Resolving deltas: 25% (120/466) Resolving deltas: 26% (124/466) Resolving deltas: 27% (126/466) Resolving deltas: 28% (131/466) Resolving deltas: 29% (136/466) Resolving deltas: 30% (141/466) Resolving deltas: 31% (145/466) Resolving deltas: 32% (150/466) Resolving deltas: 33% (154/466) Resolving deltas: 34% (159/466) Resolving deltas: 35% (164/466) Resolving deltas: 36% (168/466) Resolving deltas: 37% (175/466) Resolving deltas: 39% (183/466) Resolving deltas: 40% (189/466) Resolving deltas: 41% (195/466) Resolving deltas: 42% (199/466) Resolving deltas: 44% (206/466) Resolving deltas: 45% (211/466) Resolving deltas: 46% (215/466) Resolving deltas: 47% (222/466) Resolving deltas: 48% (224/466) Resolving deltas: 50% (236/466) Resolving deltas: 52% (245/466) Resolving deltas: 53% (250/466) Resolving deltas: 54% (253/466) Resolving deltas: 55% (257/466) Resolving deltas: 56% (261/466) Resolving deltas: 57% (266/466) Resolving deltas: 58% (271/466) Resolving deltas: 59% (275/466) Resolving deltas: 60% (280/466) Resolving deltas: 61% (285/466) Resolving deltas: 62% (289/466) Resolving deltas: 63% (294/466) Resolving deltas: 64% (299/466) Resolving deltas: 65% (303/466) Resolving deltas: 66% (308/466) Resolving deltas: 67% (314/466) Resolving deltas: 68% (317/466) Resolving deltas: 69% (322/466) Resolving deltas: 70% (327/466) Resolving deltas: 71% (331/466) Resolving deltas: 72% (336/466) Resolving deltas: 73% (341/466) Resolving deltas: 74% (345/466) Resolving deltas: 75% (350/466) Resolving deltas: 76% (355/466) Resolving deltas: 77% (360/466) Resolving deltas: 78% (366/466) Resolving deltas: 79% (370/466) Resolving deltas: 80% (374/466) Resolving deltas: 81% (378/466) Resolving deltas: 82% (385/466) Resolving deltas: 83% (390/466) Resolving deltas: 84% (392/466) Resolving deltas: 85% (398/466) Resolving deltas: 86% (402/466) Resolving deltas: 87% (406/466) Resolving deltas: 88% (411/466) Resolving deltas: 89% (415/466) Resolving deltas: 90% (420/466) Resolving deltas: 91% (425/466) Resolving deltas: 92% (429/466) Resolving deltas: 93% (434/466) Resolving deltas: 94% (439/466) Resolving deltas: 95% (443/466) Resolving deltas: 96% (448/466) Resolving deltas: 97% (453/466) Resolving deltas: 98% (457/466) Resolving deltas: 99% (462/466) Resolving deltas: 100% (466/466) Resolving deltas: 100% (466/466), completed with 250 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2422/head: No such file or directory
! d4570c1...1cc642c refs/pull/2422/head -> origin/pr/2422/head (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2455/merge -> origin/pr/2455/merge
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a8edbb81f340578966400d106297c1732ca3b7fd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a8edbb81f340578966400d106297c1732ca3b7fd
> git rev-list a8edbb81f340578966400d106297c1732ca3b7fd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1172578420571574090.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8112514585231301814.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson908420846741508008.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1863672211438700698.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-07 12:02:53,026 b7bd2e50 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/b7bd2e50/pkb.log
2017-04-07 12:02:53,027 b7bd2e50 MainThread INFO PerfKitBenchmarker version: v1.11.0-35-g0f7ba26
2017-04-07 12:02:53,027 b7bd2e50 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-07 12:02:53,413 b7bd2e50 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-07 12:02:53,516 b7bd2e50 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-07 12:02:53,519 b7bd2e50 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-07 12:02:53,519 b7bd2e50 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-07 12:02:53,524 b7bd2e50 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-07 12:02:53,526 b7bd2e50 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-07 12:02:53,548 b7bd2e50 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-07 12:02:53,548 b7bd2e50 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/b7bd2e50/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #278
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/278/display/redirect?page=changes>
Changes:
[klk] Revise MapState and SetState APIs to leverage ReadableState
------------------------------------------
[...truncated 231.51 KB...]
remote: Counting objects: 6136, done.
remote: Compressing objects: 0% (1/629) remote: Compressing objects: 1% (7/629) remote: Compressing objects: 2% (13/629) remote: Compressing objects: 3% (19/629) remote: Compressing objects: 4% (26/629) remote: Compressing objects: 5% (32/629) remote: Compressing objects: 6% (38/629) remote: Compressing objects: 7% (45/629) remote: Compressing objects: 8% (51/629) remote: Compressing objects: 9% (57/629) remote: Compressing objects: 10% (63/629) remote: Compressing objects: 11% (70/629) remote: Compressing objects: 12% (76/629) remote: Compressing objects: 13% (82/629) remote: Compressing objects: 14% (89/629) remote: Compressing objects: 15% (95/629) remote: Compressing objects: 16% (101/629) remote: Compressing objects: 17% (107/629) remote: Compressing objects: 18% (114/629) remote: Compressing objects: 19% (120/629) remote: Compressing objects: 20% (126/629) remote: Compressing objects: 21% (133/629) remote: Compressing objects: 22% (139/629) remote: Compressing objects: 23% (145/629) remote: Compressing objects: 24% (151/629) remote: Compressing objects: 25% (158/629) remote: Compressing objects: 26% (164/629) remote: Compressing objects: 27% (170/629) remote: Compressing objects: 28% (177/629) remote: Compressing objects: 29% (183/629) remote: Compressing objects: 30% (189/629) remote: Compressing objects: 31% (195/629) remote: Compressing objects: 32% (202/629) remote: Compressing objects: 33% (208/629) remote: Compressing objects: 34% (214/629) remote: Compressing objects: 35% (221/629) remote: Compressing objects: 36% (227/629) remote: Compressing objects: 37% (233/629) remote: Compressing objects: 38% (240/629) remote: Compressing objects: 39% (246/629) remote: Compressing objects: 40% (252/629) remote: Compressing objects: 41% (258/629) remote: Compressing objects: 42% (265/629) remote: Compressing objects: 43% (271/629) remote: Compressing objects: 44% (277/629) remote: Compressing objects: 45% (284/629) remote: Compressing objects: 46% (290/629) remote: Compressing objects: 47% (296/629) remote: Compressing objects: 48% (302/629) remote: Compressing objects: 49% (309/629) remote: Compressing objects: 50% (315/629) remote: Compressing objects: 51% (321/629) remote: Compressing objects: 52% (328/629) remote: Compressing objects: 53% (334/629) remote: Compressing objects: 54% (340/629) remote: Compressing objects: 55% (346/629) remote: Compressing objects: 56% (353/629) remote: Compressing objects: 57% (359/629) remote: Compressing objects: 58% (365/629) remote: Compressing objects: 59% (372/629) remote: Compressing objects: 60% (378/629) remote: Compressing objects: 61% (384/629) remote: Compressing objects: 62% (390/629) remote: Compressing objects: 63% (397/629) remote: Compressing objects: 64% (403/629) remote: Compressing objects: 65% (409/629) remote: Compressing objects: 66% (416/629) remote: Compressing objects: 67% (422/629) remote: Compressing objects: 68% (428/629) remote: Compressing objects: 69% (435/629) remote: Compressing objects: 70% (441/629) remote: Compressing objects: 71% (447/629) remote: Compressing objects: 72% (453/629) remote: Compressing objects: 73% (460/629) remote: Compressing objects: 74% (466/629) remote: Compressing objects: 75% (472/629) remote: Compressing objects: 76% (479/629) remote: Compressing objects: 77% (485/629) remote: Compressing objects: 78% (491/629) remote: Compressing objects: 79% (497/629) remote: Compressing objects: 80% (504/629) remote: Compressing objects: 81% (510/629) remote: Compressing objects: 82% (516/629) remote: Compressing objects: 83% (523/629) remote: Compressing objects: 84% (529/629) remote: Compressing objects: 85% (535/629) remote: Compressing objects: 86% (541/629) remote: Compressing objects: 87% (548/629) remote: Compressing objects: 88% (554/629) remote: Compressing objects: 89% (560/629) remote: Compressing objects: 90% (567/629) remote: Compressing objects: 91% (573/629) remote: Compressing objects: 92% (579/629) remote: Compressing objects: 93% (585/629) remote: Compressing objects: 94% (592/629) remote: Compressing objects: 95% (598/629) remote: Compressing objects: 96% (604/629) remote: Compressing objects: 97% (611/629) remote: Compressing objects: 98% (617/629) remote: Compressing objects: 99% (623/629) remote: Compressing objects: 100% (629/629) remote: Compressing objects: 100% (629/629), done.
Receiving objects: 0% (1/6136) Receiving objects: 1% (62/6136) Receiving objects: 2% (123/6136) Receiving objects: 3% (185/6136) Receiving objects: 4% (246/6136) Receiving objects: 5% (307/6136) Receiving objects: 6% (369/6136) Receiving objects: 7% (430/6136) Receiving objects: 8% (491/6136) Receiving objects: 9% (553/6136) Receiving objects: 10% (614/6136) Receiving objects: 11% (675/6136) Receiving objects: 12% (737/6136) Receiving objects: 13% (798/6136) Receiving objects: 14% (860/6136) Receiving objects: 15% (921/6136) Receiving objects: 16% (982/6136) Receiving objects: 17% (1044/6136) Receiving objects: 18% (1105/6136) Receiving objects: 19% (1166/6136) Receiving objects: 20% (1228/6136) Receiving objects: 21% (1289/6136) Receiving objects: 22% (1350/6136) Receiving objects: 23% (1412/6136) Receiving objects: 24% (1473/6136) Receiving objects: 25% (1534/6136) Receiving objects: 26% (1596/6136) Receiving objects: 27% (1657/6136) Receiving objects: 28% (1719/6136) Receiving objects: 29% (1780/6136) Receiving objects: 30% (1841/6136) Receiving objects: 31% (1903/6136) Receiving objects: 32% (1964/6136) Receiving objects: 33% (2025/6136) Receiving objects: 34% (2087/6136) Receiving objects: 35% (2148/6136) Receiving objects: 36% (2209/6136) Receiving objects: 37% (2271/6136) Receiving objects: 38% (2332/6136) Receiving objects: 39% (2394/6136) Receiving objects: 40% (2455/6136) Receiving objects: 41% (2516/6136) Receiving objects: 42% (2578/6136) Receiving objects: 43% (2639/6136) Receiving objects: 44% (2700/6136) Receiving objects: 45% (2762/6136) Receiving objects: 46% (2823/6136) Receiving objects: 47% (2884/6136) Receiving objects: 48% (2946/6136) Receiving objects: 49% (3007/6136) Receiving objects: 50% (3068/6136) Receiving objects: 51% (3130/6136) Receiving objects: 52% (3191/6136) Receiving objects: 53% (3253/6136) Receiving objects: 54% (3314/6136) Receiving objects: 55% (3375/6136) Receiving objects: 56% (3437/6136) Receiving objects: 57% (3498/6136) Receiving objects: 58% (3559/6136) Receiving objects: 59% (3621/6136) Receiving objects: 60% (3682/6136) Receiving objects: 61% (3743/6136) Receiving objects: 62% (3805/6136) Receiving objects: 63% (3866/6136) Receiving objects: 64% (3928/6136) Receiving objects: 65% (3989/6136) Receiving objects: 66% (4050/6136) Receiving objects: 67% (4112/6136) Receiving objects: 68% (4173/6136) Receiving objects: 69% (4234/6136) Receiving objects: 70% (4296/6136) Receiving objects: 71% (4357/6136) Receiving objects: 72% (4418/6136) Receiving objects: 73% (4480/6136) Receiving objects: 74% (4541/6136) Receiving objects: 75% (4602/6136) Receiving objects: 76% (4664/6136) Receiving objects: 77% (4725/6136) Receiving objects: 78% (4787/6136) Receiving objects: 79% (4848/6136) Receiving objects: 80% (4909/6136) Receiving objects: 81% (4971/6136) Receiving objects: 82% (5032/6136) Receiving objects: 83% (5093/6136) Receiving objects: 84% (5155/6136) Receiving objects: 85% (5216/6136) Receiving objects: 86% (5277/6136) Receiving objects: 87% (5339/6136) Receiving objects: 88% (5400/6136) Receiving objects: 89% (5462/6136) Receiving objects: 90% (5523/6136) Receiving objects: 91% (5584/6136) Receiving objects: 92% (5646/6136) Receiving objects: 93% (5707/6136) Receiving objects: 94% (5768/6136) Receiving objects: 95% (5830/6136) remote: Total 6136 (delta 2029), reused 1746 (delta 1746), pack-reused 3376
Receiving objects: 96% (5891/6136) Receiving objects: 97% (5952/6136) Receiving objects: 98% (6014/6136) Receiving objects: 99% (6075/6136) Receiving objects: 100% (6136/6136) Receiving objects: 100% (6136/6136), 960.78 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/2411) Resolving deltas: 1% (25/2411) Resolving deltas: 2% (52/2411) Resolving deltas: 3% (73/2411) Resolving deltas: 4% (104/2411) Resolving deltas: 5% (121/2411) Resolving deltas: 7% (175/2411) Resolving deltas: 8% (194/2411) Resolving deltas: 9% (224/2411) Resolving deltas: 10% (246/2411) Resolving deltas: 11% (266/2411) Resolving deltas: 12% (291/2411) Resolving deltas: 13% (314/2411) Resolving deltas: 14% (339/2411) Resolving deltas: 15% (363/2411) Resolving deltas: 16% (390/2411) Resolving deltas: 17% (418/2411) Resolving deltas: 18% (435/2411) Resolving deltas: 19% (459/2411) Resolving deltas: 20% (483/2411) Resolving deltas: 21% (520/2411) Resolving deltas: 22% (532/2411) Resolving deltas: 23% (564/2411) Resolving deltas: 24% (582/2411) Resolving deltas: 25% (603/2411) Resolving deltas: 26% (629/2411) Resolving deltas: 27% (651/2411) Resolving deltas: 28% (677/2411) Resolving deltas: 29% (719/2411) Resolving deltas: 30% (737/2411) Resolving deltas: 31% (749/2411) Resolving deltas: 32% (776/2411) Resolving deltas: 33% (796/2411) Resolving deltas: 34% (820/2411) Resolving deltas: 36% (886/2411) Resolving deltas: 37% (897/2411) Resolving deltas: 38% (918/2411) Resolving deltas: 39% (942/2411) Resolving deltas: 41% (991/2411) Resolving deltas: 46% (1121/2411) Resolving deltas: 47% (1134/2411) Resolving deltas: 48% (1163/2411) Resolving deltas: 49% (1183/2411) Resolving deltas: 50% (1206/2411) Resolving deltas: 56% (1354/2411) Resolving deltas: 57% (1379/2411) Resolving deltas: 58% (1399/2411) Resolving deltas: 59% (1427/2411) Resolving deltas: 60% (1448/2411) Resolving deltas: 61% (1476/2411) Resolving deltas: 62% (1497/2411) Resolving deltas: 63% (1520/2411) Resolving deltas: 64% (1544/2411) Resolving deltas: 65% (1568/2411) Resolving deltas: 69% (1687/2411) Resolving deltas: 70% (1688/2411) Resolving deltas: 71% (1713/2411) Resolving deltas: 72% (1740/2411) Resolving deltas: 77% (1876/2411) Resolving deltas: 78% (1882/2411) Resolving deltas: 79% (1906/2411) Resolving deltas: 80% (1932/2411) Resolving deltas: 81% (1960/2411) Resolving deltas: 82% (1981/2411) Resolving deltas: 83% (2012/2411) Resolving deltas: 84% (2027/2411) Resolving deltas: 85% (2055/2411) Resolving deltas: 86% (2074/2411) Resolving deltas: 87% (2109/2411) Resolving deltas: 88% (2124/2411) Resolving deltas: 89% (2168/2411) Resolving deltas: 90% (2170/2411) Resolving deltas: 91% (2196/2411) Resolving deltas: 92% (2220/2411) Resolving deltas: 93% (2243/2411) Resolving deltas: 94% (2267/2411) Resolving deltas: 95% (2291/2411) Resolving deltas: 96% (2315/2411) Resolving deltas: 97% (2339/2411) Resolving deltas: 98% (2365/2411) Resolving deltas: 99% (2392/2411) Resolving deltas: 100% (2411/2411) Resolving deltas: 100% (2411/2411), completed with 511 local objects.
b92032f..a8edbb8 master -> origin/master
error: unable to resolve reference refs/remotes/origin/pr/1687/merge: No such file or directory
! 25dc67e...af14cb9 refs/pull/1687/merge -> origin/pr/1687/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1725/merge: No such file or directory
! 28be205...cc7ca97 refs/pull/1725/merge -> origin/pr/1725/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1729/merge: No such file or directory
! ce833f1...9eabc0b refs/pull/1729/merge -> origin/pr/1729/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1851/merge: No such file or directory
! f9f62ca...a582cfe refs/pull/1851/merge -> origin/pr/1851/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1862/merge: No such file or directory
! 835df26...6ad8353 refs/pull/1862/merge -> origin/pr/1862/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/1864/merge: No such file or directory
! 4be58cd...3a99c7d refs/pull/1864/merge -> origin/pr/1864/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2007/merge: No such file or directory
! 0ba676a...e9ba2e1 refs/pull/2007/merge -> origin/pr/2007/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2022/merge: No such file or directory
! c49acd9...17613e8 refs/pull/2022/merge -> origin/pr/2022/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2057/merge: No such file or directory
! c077efd...97f3d64 refs/pull/2057/merge -> origin/pr/2057/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2113/merge: No such file or directory
! a256bf5...7994afb refs/pull/2113/merge -> origin/pr/2113/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2154/merge: No such file or directory
! 9266535...d8b18a8 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2166/head: No such file or directory
! ba7e7ee..77cfbb6 refs/pull/2166/head -> origin/pr/2166/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2166/merge: No such file or directory
! 38d036b...ea41088 refs/pull/2166/merge -> origin/pr/2166/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2175/merge: No such file or directory
! 1a17360...f1f7865 refs/pull/2175/merge -> origin/pr/2175/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2204/merge: No such file or directory
! 703ea7a...6b7b3b6 refs/pull/2204/merge -> origin/pr/2204/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! cd60795...7976518 refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! f350c58...fd36974 refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2262/merge: No such file or directory
! 42a832e...19e48d2 refs/pull/2262/merge -> origin/pr/2262/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2263/merge: No such file or directory
! 4d6426f...a56c856 refs/pull/2263/merge -> origin/pr/2263/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! c740163...458f4cf refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! a26a9dd...120d567 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 535a906...f383169 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! a6e9336...8443a9f refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! e33bd3f...79581ed refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! 3ea2bc5...eab2a9b refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! bdd60e5...8130f6f refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! a46143f...77b8bc4 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 3bab45a...f93ad98 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! cf68a2a...9e50ba9 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2371/merge: No such file or directory
! c81e92a...828ad1b refs/pull/2371/merge -> origin/pr/2371/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 76c3277...83bfc3b refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! e9e50f9...de0f48f refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! f35fca5...6512d97 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2420/merge: No such file or directory
! b94f7bb...9cd4737 refs/pull/2420/merge -> origin/pr/2420/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! c7a5c79...2d39b03 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2422/merge: No such file or directory
! 8e85499...44ab6aa refs/pull/2422/merge -> origin/pr/2422/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! 7b35d62..3c19c57 refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 99cd8b0...52052dd refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! db91687...ffe6fb1 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! e848793...ab72049 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 9ec3920...9b409ac refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2455/merge -> origin/pr/2455/merge
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
* [new ref] refs/pull/2457/head -> origin/pr/2457/head
* [new ref] refs/pull/2457/merge -> origin/pr/2457/merge
* [new ref] refs/pull/2458/head -> origin/pr/2458/head
* [new ref] refs/pull/2458/merge -> origin/pr/2458/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 3f33d6a...1885e31 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a8edbb81f340578966400d106297c1732ca3b7fd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a8edbb81f340578966400d106297c1732ca3b7fd
> git rev-list b92032ff6d3fba7d29dd73f602977137b7539482 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3635742997135918373.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7010988763427471650.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8859646527663805576.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5105109541696400198.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-07 06:03:14,824 f926cb26 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/f926cb26/pkb.log
2017-04-07 06:03:14,824 f926cb26 MainThread INFO PerfKitBenchmarker version: v1.11.0-35-g0f7ba26
2017-04-07 06:03:14,824 f926cb26 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-07 06:03:15,085 f926cb26 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-07 06:03:15,174 f926cb26 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-07 06:03:15,176 f926cb26 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-07 06:03:15,176 f926cb26 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-07 06:03:15,181 f926cb26 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-07 06:03:15,204 f926cb26 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-07 06:03:15,257 f926cb26 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-07 06:03:15,257 f926cb26 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/f926cb26/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #277
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/277/display/redirect?page=changes>
Changes:
[klk] Rename filePath to filePattern in NumbedShardedFile
[chamikara] [BEAM-1892] File size estimation process reporting
[klk] Rename FunctionSpec and UrnWithParameter to their (hopefully) final
[klk] Rename CombiningState to GroupingState
[klk] Rename AccumulatorCombiningState to CombiningState
[klk] Rename combiningValue to combining in StateSpecs
[klk] Upgrade Dataflow worker image to beam-master-20170405
[tgroh] Remove DirectSideInputReader, PTuple
[klk] Remove NeedsRunner category tags from non-core libraries
[klk] Remove ValidatesRunner category tags from non-core libraries
------------------------------------------
[...truncated 257.81 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2375/merge: No such file or directory
! aa0dfb8...579a3ed refs/pull/2375/merge -> origin/pr/2375/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2376/merge: No such file or directory
! 8eb0d7b...c0a868a refs/pull/2376/merge -> origin/pr/2376/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! 46ac43b...cd1e7e6 refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2378/merge: No such file or directory
! 6d02cef...8a8f567 refs/pull/2378/merge -> origin/pr/2378/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! 6ea3244...c666b42 refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! b61a077...6c67869 refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! 3f4f704...72bda66 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 76681bd...b25ebf7 refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! 1fc1ce3...e5406b6 refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! 126fd22...345486b refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 4fc59f2...11d5ff0 refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2390/merge: No such file or directory
! c44f557...c46c152 refs/pull/2390/merge -> origin/pr/2390/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! afc29f1...e5b3a01 refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/merge: No such file or directory
! f2fc983...146853b refs/pull/2393/merge -> origin/pr/2393/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 353fc31...27afb8d refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! 4dd192c...423d213 refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! 1a1c94d...73e087b refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 8972aed...76c3277 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2403/merge: No such file or directory
! 9e49d3b...580df8b refs/pull/2403/merge -> origin/pr/2403/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2404/merge: No such file or directory
! a2d92cb...d6a1da9 refs/pull/2404/merge -> origin/pr/2404/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! ca91ce5...e9e50f9 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2407/merge: No such file or directory
! a851062...39572fd refs/pull/2407/merge -> origin/pr/2407/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2409/merge: No such file or directory
! a8df393...2287b56 refs/pull/2409/merge -> origin/pr/2409/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 697841c...40e1cd4 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2411/merge: No such file or directory
! 75e6779...859dc99 refs/pull/2411/merge -> origin/pr/2411/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2412/merge: No such file or directory
! a234a30...4ada4ab refs/pull/2412/merge -> origin/pr/2412/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2413/head: No such file or directory
! da91465...359040e refs/pull/2413/head -> origin/pr/2413/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! aa9c1f4...53ddaa8 refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! d2197ac...867d5d1 refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 31e5a7b...f35fca5 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2418/merge: No such file or directory
! ad756e5...af5437d refs/pull/2418/merge -> origin/pr/2418/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2419/merge: No such file or directory
! 281f64f...8db8537 refs/pull/2419/merge -> origin/pr/2419/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2420/merge: No such file or directory
! 034e416...b94f7bb refs/pull/2420/merge -> origin/pr/2420/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 7823d4b...c7a5c79 refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! d1d696c...99cd8b0 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2424/merge: No such file or directory
! 527f326...89b077a refs/pull/2424/merge -> origin/pr/2424/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! a90e065...db91687 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2427/merge: No such file or directory
! d0ce6ac...c54a4e5 refs/pull/2427/merge -> origin/pr/2427/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! 2b768ef...cbedaef refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/head: No such file or directory
! 50008cd...854b3a9 refs/pull/2430/head -> origin/pr/2430/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! 09baed4...e848793 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 3d10c05...9ec3920 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! 9a5d150...fc8dcc1 refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2433/merge: No such file or directory
! 2938cb2...07a20bd refs/pull/2433/merge -> origin/pr/2433/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! b3600ae...bf0f4e6 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2435/merge: No such file or directory
! b290647...a5e9877 refs/pull/2435/merge -> origin/pr/2435/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
* [new ref] refs/pull/2454/head -> origin/pr/2454/head
* [new ref] refs/pull/2454/merge -> origin/pr/2454/merge
* [new ref] refs/pull/2455/head -> origin/pr/2455/head
* [new ref] refs/pull/2455/merge -> origin/pr/2455/merge
* [new ref] refs/pull/2456/head -> origin/pr/2456/head
* [new ref] refs/pull/2456/merge -> origin/pr/2456/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 6f107dc...3f33d6a refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision b92032ff6d3fba7d29dd73f602977137b7539482 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f b92032ff6d3fba7d29dd73f602977137b7539482
> git rev-list f87597e102a855df7e886895991323c9c7fa16c1 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2227839966142355406.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2811676637686601200.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson222817985393022412.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3498468960362010485.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-07 00:02:00,439 3bf679d2 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3bf679d2/pkb.log
2017-04-07 00:02:00,439 3bf679d2 MainThread INFO PerfKitBenchmarker version: v1.11.0-35-g0f7ba26
2017-04-07 00:02:00,440 3bf679d2 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-07 00:02:00,664 3bf679d2 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-07 00:02:00,751 3bf679d2 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-07 00:02:00,753 3bf679d2 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-07 00:02:00,753 3bf679d2 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-07 00:02:00,759 3bf679d2 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-07 00:02:00,760 3bf679d2 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-07 00:02:00,786 3bf679d2 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-07 00:02:00,786 3bf679d2 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3bf679d2/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #276
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/276/display/redirect?page=changes>
Changes:
[davor] HadoopInputFormatIO with junits
[jbonofre] [BEAM-1856] Use the same configuration in master thread and slave thread
------------------------------------------
[...truncated 251.23 KB...]
! a6c7fcc...26c5ab8 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2286/merge: No such file or directory
! 8b3b813...bf91010 refs/pull/2286/merge -> origin/pr/2286/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2312/merge: No such file or directory
! 78f8ea1...2979e51 refs/pull/2312/merge -> origin/pr/2312/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2326/merge: No such file or directory
! 45d1301...e76a4d1 refs/pull/2326/merge -> origin/pr/2326/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2328/merge: No such file or directory
! 10a7f6b...1934585 refs/pull/2328/merge -> origin/pr/2328/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2329/merge: No such file or directory
! cddfd7d...ac11128 refs/pull/2329/merge -> origin/pr/2329/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 8e139c6...0781db6 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 38bdf29...76cd16f refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! 0fa2ae5...96698a8 refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! be74189...2038f4a refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! e9e597b...a7236cc refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! d95d324...1bf976e refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! ce49374...77800ba refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 52babb9...fc09f7b refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2364/merge: No such file or directory
! c768e09...5cd66bf refs/pull/2364/merge -> origin/pr/2364/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2369/merge: No such file or directory
! 03bdfc1...e8325d1 refs/pull/2369/merge -> origin/pr/2369/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2376/merge: No such file or directory
! 6c54337...8eb0d7b refs/pull/2376/merge -> origin/pr/2376/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! fd20276...1fc1ce3 refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! ea97579...f5d10b5 refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! cf9e449...8972aed refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 6df28c8...ca91ce5 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2409/merge: No such file or directory
! 8a90fbb...a8df393 refs/pull/2409/merge -> origin/pr/2409/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 43d9583...697841c refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2411/merge: No such file or directory
! d9d84fc...75e6779 refs/pull/2411/merge -> origin/pr/2411/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2412/merge: No such file or directory
! 7a87898...a234a30 refs/pull/2412/merge -> origin/pr/2412/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2413/merge: No such file or directory
! 58dccb7...3fb1032 refs/pull/2413/merge -> origin/pr/2413/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 861cab5...aa9c1f4 refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! b2e68b1...d2197ac refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/head: No such file or directory
! 8ee6b7d..83bad83 refs/pull/2417/head -> origin/pr/2417/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! bf82725...31e5a7b refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2418/merge: No such file or directory
! a4347ab...ad756e5 refs/pull/2418/merge -> origin/pr/2418/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2419/merge: No such file or directory
! 44ca208...281f64f refs/pull/2419/merge -> origin/pr/2419/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2420/merge: No such file or directory
! c6b8b98...034e416 refs/pull/2420/merge -> origin/pr/2420/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 330657c...7823d4b refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/head: No such file or directory
! 9041172..7b35d62 refs/pull/2423/head -> origin/pr/2423/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 9f9268a...d1d696c refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2424/merge: No such file or directory
! e394246...527f326 refs/pull/2424/merge -> origin/pr/2424/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2425/merge: No such file or directory
! a008d15...a6b2180 refs/pull/2425/merge -> origin/pr/2425/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! c6c9bbc...a90e065 refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2427/merge: No such file or directory
! 380750e...d0ce6ac refs/pull/2427/merge -> origin/pr/2427/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! 861e412...2b768ef refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/head: No such file or directory
! 045ef2d...50008cd refs/pull/2430/head -> origin/pr/2430/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! a8f3a9c...09baed4 refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 225fb2e...3d10c05 refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! 8dd8b16...9a5d150 refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2433/merge: No such file or directory
! 61b7507...2938cb2 refs/pull/2433/merge -> origin/pr/2433/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 8e4b5f7...b3600ae refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2435/merge: No such file or directory
! d78c64e...b290647 refs/pull/2435/merge -> origin/pr/2435/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
* [new ref] refs/pull/2452/head -> origin/pr/2452/head
* [new ref] refs/pull/2452/merge -> origin/pr/2452/merge
* [new ref] refs/pull/2453/head -> origin/pr/2453/head
* [new ref] refs/pull/2453/merge -> origin/pr/2453/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 55eb89a...6f107dc refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! 31b1716...7a7cff5 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f87597e102a855df7e886895991323c9c7fa16c1 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f f87597e102a855df7e886895991323c9c7fa16c1
> git rev-list 9c284d6257f44b343af606ff9e47b9623484f9d1 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6221488827011920638.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2726270631150982340.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5840423985034259715.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1792050350600322973.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-06 18:02:03,667 74579ec8 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/74579ec8/pkb.log
2017-04-06 18:02:03,668 74579ec8 MainThread INFO PerfKitBenchmarker version: v1.11.0-35-g0f7ba26
2017-04-06 18:02:03,668 74579ec8 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-06 18:02:04,127 74579ec8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-06 18:02:04,217 74579ec8 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-06 18:02:04,220 74579ec8 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-06 18:02:04,220 74579ec8 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-06 18:02:04,225 74579ec8 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-06 18:02:04,227 74579ec8 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-06 18:02:04,250 74579ec8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-06 18:02:04,250 74579ec8 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/74579ec8/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #275
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/275/display/redirect?page=changes>
Changes:
[altay] Replace Any type with a KV type for inputs of a GroupByKey step
[tgroh] Use WinodwMappingFn where possible
[tgroh] Add Initial Materializations
[tgroh] Remove unused import in ViewFn
[dhalperi] DataflowPipelineJob: handle concurrent cancel and finish
[tgroh] Fix Compile Break in PTransformMatchersTest
[jbonofre] Add javadoc to getEstimatedSizeBytes
[jbonofre] Fix checkstyle issue
------------------------------------------
[...truncated 247.11 KB...]
! 135d980...e9e597b refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2347/merge: No such file or directory
! 61649b9...232ffb4 refs/pull/2347/merge -> origin/pr/2347/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/merge: No such file or directory
! fdbe070...f4c651d refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2350/merge: No such file or directory
! 61acff5...45af18c refs/pull/2350/merge -> origin/pr/2350/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2352/merge: No such file or directory
! 9a2631b...a2493cf refs/pull/2352/merge -> origin/pr/2352/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! ffb2932...d95d324 refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! c251df6...ce49374 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/head: No such file or directory
! 3407ffb..3e3557b refs/pull/2363/head -> origin/pr/2363/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 41c3a3f...52babb9 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 6ce0b46...0f65b54 refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/merge: No such file or directory
! aa3817c...cd16fd5 refs/pull/2368/merge -> origin/pr/2368/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! f9db63a...6ea3244 refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! 1b76604...b61a077 refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! a302f42...3f4f704 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 7fd9d5b...76681bd refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! 928a664...126fd22 refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 64711d2...4fc59f2 refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2390/merge: No such file or directory
! dd408be...c44f557 refs/pull/2390/merge -> origin/pr/2390/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! 7c97f22...afc29f1 refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/merge: No such file or directory
! 9bdcfc1...f2fc983 refs/pull/2393/merge -> origin/pr/2393/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! ad2ff75...353fc31 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! 4e75764...4dd192c refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! 0dd6517...ea97579 refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! eba7389...1a1c94d refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! dd34af9...cf9e449 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2405/merge: No such file or directory
! c8c78af...2c9d26c refs/pull/2405/merge -> origin/pr/2405/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! 074e1a5...6df28c8 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2409/merge: No such file or directory
! c0df13c...8a90fbb refs/pull/2409/merge -> origin/pr/2409/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! a7eb31e...43d9583 refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2413/head: No such file or directory
! 7f6abcb...da91465 refs/pull/2413/head -> origin/pr/2413/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2413/merge: No such file or directory
! 297ce47...58dccb7 refs/pull/2413/merge -> origin/pr/2413/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 133f4e6...861cab5 refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! c117754...b2e68b1 refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/head: No such file or directory
! d6cdee3..8ee6b7d refs/pull/2417/head -> origin/pr/2417/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! 1c489b2...bf82725 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2420/head: No such file or directory
! 9bc116b..13d370e refs/pull/2420/head -> origin/pr/2420/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2420/merge: No such file or directory
! 167e650...c6b8b98 refs/pull/2420/merge -> origin/pr/2420/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 9393b4f...330657c refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2422/merge: No such file or directory
! cca64b8...8e85499 refs/pull/2422/merge -> origin/pr/2422/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! c8c3a93...9f9268a refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2424/merge: No such file or directory
! 9707448...e394246 refs/pull/2424/merge -> origin/pr/2424/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2425/merge: No such file or directory
! 3c8035e...a008d15 refs/pull/2425/merge -> origin/pr/2425/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/head: No such file or directory
! 628f36c...f413860 refs/pull/2426/head -> origin/pr/2426/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 0241f1c...c6c9bbc refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2427/merge: No such file or directory
! 304f9d4...380750e refs/pull/2427/merge -> origin/pr/2427/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! edbb21e...861e412 refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 6912a7a...225fb2e refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! f5d00a9...8dd8b16 refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2434/merge: No such file or directory
! 8239bab...8e4b5f7 refs/pull/2434/merge -> origin/pr/2434/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2435/merge: No such file or directory
! 8688657...d78c64e refs/pull/2435/merge -> origin/pr/2435/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
* [new ref] refs/pull/2446/head -> origin/pr/2446/head
* [new ref] refs/pull/2446/merge -> origin/pr/2446/merge
* [new ref] refs/pull/2447/head -> origin/pr/2447/head
* [new ref] refs/pull/2447/merge -> origin/pr/2447/merge
* [new ref] refs/pull/2448/head -> origin/pr/2448/head
* [new ref] refs/pull/2449/head -> origin/pr/2449/head
* [new ref] refs/pull/2449/merge -> origin/pr/2449/merge
* [new ref] refs/pull/2450/head -> origin/pr/2450/head
* [new ref] refs/pull/2450/merge -> origin/pr/2450/merge
* [new ref] refs/pull/2451/head -> origin/pr/2451/head
* [new ref] refs/pull/2451/merge -> origin/pr/2451/merge
error: unable to resolve reference refs/remotes/origin/pr/311/merge: No such file or directory
! 9cbefd4...b1b5420 refs/pull/311/merge -> origin/pr/311/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! e565b43...55eb89a refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor698.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 9c284d6257f44b343af606ff9e47b9623484f9d1 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 9c284d6257f44b343af606ff9e47b9623484f9d1
> git rev-list 697b19fe5768cdc85aeaa54c425cb3a61a6167f4 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3261434973419234073.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7204966785854422760.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5556128257005510616.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2715455026101079181.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-06 12:02:31,838 eb0ce979 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/eb0ce979/pkb.log
2017-04-06 12:02:31,838 eb0ce979 MainThread INFO PerfKitBenchmarker version: v1.11.0-35-g0f7ba26
2017-04-06 12:02:31,838 eb0ce979 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-06 12:02:31,933 eb0ce979 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-06 12:02:32,022 eb0ce979 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-06 12:02:32,024 eb0ce979 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-06 12:02:32,024 eb0ce979 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-06 12:02:32,030 eb0ce979 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-06 12:02:32,032 eb0ce979 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-06 12:02:32,057 eb0ce979 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-06 12:02:32,057 eb0ce979 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/eb0ce979/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #274
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/274/display/redirect?page=changes>
Changes:
[tgroh] Exclude UsesTestStream Tests for more builds
[kirpichov] Clarifies BigQueryIO javadoc
[tgroh] Suppress TestStream tests in Dataflow
[dhalperi] [BEAM-1881] Exclude protobuf-lite and replace with protobuf-java
[altay] Do not send on_success_matcher to remote executors
[tgroh] Remove single-matcher replacement API
[altay] Revert "Revert "Add ValueProvider class for FileBasedSource I/O
[dhalperi] Fixed a comment in AfterWatermark
[dhalperi] [BEAM-1269] Update bigtable library dependency
------------------------------------------
[...truncated 252.52 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2347/merge: No such file or directory
! 2207b92...61649b9 refs/pull/2347/merge -> origin/pr/2347/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/merge: No such file or directory
! ec3e51d...fdbe070 refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2350/merge: No such file or directory
! 822cf4d...61acff5 refs/pull/2350/merge -> origin/pr/2350/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2351/merge: No such file or directory
! 662028f...c9f9e2f refs/pull/2351/merge -> origin/pr/2351/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2352/merge: No such file or directory
! 6773c57...9a2631b refs/pull/2352/merge -> origin/pr/2352/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! a67201d...ffb2932 refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! a9bcdcb...c251df6 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2362/merge: No such file or directory
! d55e900...b4e6a7f refs/pull/2362/merge -> origin/pr/2362/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 50c5048...41c3a3f refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2364/merge: No such file or directory
! 75c86de...c768e09 refs/pull/2364/merge -> origin/pr/2364/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 0a97f02...6ce0b46 refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2369/merge: No such file or directory
! a10c8c8...03bdfc1 refs/pull/2369/merge -> origin/pr/2369/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2375/merge: No such file or directory
! 0883a61...aa0dfb8 refs/pull/2375/merge -> origin/pr/2375/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/head: No such file or directory
! 973a8c9...2a7d9eb refs/pull/2377/head -> origin/pr/2377/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! 4481291...46ac43b refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2379/merge: No such file or directory
! bd373f4...50feb29 refs/pull/2379/merge -> origin/pr/2379/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! 9feec00...a302f42 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! dcc5e4d...7fd9d5b refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! 7ffba0c...fd20276 refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 112e28d...64711d2 refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2390/merge: No such file or directory
! 194e4d0...dd408be refs/pull/2390/merge -> origin/pr/2390/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! 0a5b68b...7c97f22 refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/merge: No such file or directory
! e5a832c...9bdcfc1 refs/pull/2393/merge -> origin/pr/2393/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! f9e7b58...ad2ff75 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! 302d99e...4e75764 refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! 5fbd64b...0dd6517 refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! d81fa36...eba7389 refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 43a477b...dd34af9 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2405/merge: No such file or directory
! bc9057d...c8c78af refs/pull/2405/merge -> origin/pr/2405/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2406/merge: No such file or directory
! aa49cff...074e1a5 refs/pull/2406/merge -> origin/pr/2406/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2407/merge: No such file or directory
! 8224898...a851062 refs/pull/2407/merge -> origin/pr/2407/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2409/merge: No such file or directory
! 759cdd3...c0df13c refs/pull/2409/merge -> origin/pr/2409/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2410/merge: No such file or directory
! 20f2689...a7eb31e refs/pull/2410/merge -> origin/pr/2410/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2412/merge: No such file or directory
! 86fd81c...7a87898 refs/pull/2412/merge -> origin/pr/2412/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2413/merge: No such file or directory
! 28f08be...297ce47 refs/pull/2413/merge -> origin/pr/2413/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2414/merge: No such file or directory
! 86b3c88...133f4e6 refs/pull/2414/merge -> origin/pr/2414/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2415/merge: No such file or directory
! 45ba9c2...c117754 refs/pull/2415/merge -> origin/pr/2415/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/head: No such file or directory
! 0917850..d6cdee3 refs/pull/2417/head -> origin/pr/2417/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2417/merge: No such file or directory
! fee4e78...1c489b2 refs/pull/2417/merge -> origin/pr/2417/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2418/head: No such file or directory
! 1756a95...3b6a9b0 refs/pull/2418/head -> origin/pr/2418/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2418/merge: No such file or directory
! 8bd0522...a4347ab refs/pull/2418/merge -> origin/pr/2418/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2420/merge: No such file or directory
! 2516519...167e650 refs/pull/2420/merge -> origin/pr/2420/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2421/merge: No such file or directory
! 81338ea...9393b4f refs/pull/2421/merge -> origin/pr/2421/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2422/merge: No such file or directory
! edd9ac1...cca64b8 refs/pull/2422/merge -> origin/pr/2422/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2423/merge: No such file or directory
! 00255d8...c8c3a93 refs/pull/2423/merge -> origin/pr/2423/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2424/merge: No such file or directory
! e37a28a...9707448 refs/pull/2424/merge -> origin/pr/2424/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2425/merge: No such file or directory
! ef5fde3...3c8035e refs/pull/2425/merge -> origin/pr/2425/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2426/merge: No such file or directory
! 60e5d4c...0241f1c refs/pull/2426/merge -> origin/pr/2426/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/head: No such file or directory
! 0cb8355..29d6461 refs/pull/2428/head -> origin/pr/2428/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2428/merge: No such file or directory
! f3224ad...edbb21e refs/pull/2428/merge -> origin/pr/2428/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2430/merge: No such file or directory
! f470b0e...a8f3a9c refs/pull/2430/merge -> origin/pr/2430/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/head: No such file or directory
! 01e00cc...b260735 refs/pull/2431/head -> origin/pr/2431/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2431/merge: No such file or directory
! 84db753...6912a7a refs/pull/2431/merge -> origin/pr/2431/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2432/merge: No such file or directory
! 43e8296...f5d00a9 refs/pull/2432/merge -> origin/pr/2432/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2433/merge: No such file or directory
! 32ed175...61b7507 refs/pull/2433/merge -> origin/pr/2433/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2435/merge: No such file or directory
! 77d4bc8...8688657 refs/pull/2435/merge -> origin/pr/2435/merge (unable to update local ref)
* [new ref] refs/pull/2436/head -> origin/pr/2436/head
* [new ref] refs/pull/2436/merge -> origin/pr/2436/merge
* [new ref] refs/pull/2437/head -> origin/pr/2437/head
* [new ref] refs/pull/2437/merge -> origin/pr/2437/merge
* [new ref] refs/pull/2438/head -> origin/pr/2438/head
* [new ref] refs/pull/2439/head -> origin/pr/2439/head
* [new ref] refs/pull/2439/merge -> origin/pr/2439/merge
* [new ref] refs/pull/2440/head -> origin/pr/2440/head
* [new ref] refs/pull/2440/merge -> origin/pr/2440/merge
* [new ref] refs/pull/2441/head -> origin/pr/2441/head
* [new ref] refs/pull/2441/merge -> origin/pr/2441/merge
* [new ref] refs/pull/2442/head -> origin/pr/2442/head
* [new ref] refs/pull/2442/merge -> origin/pr/2442/merge
* [new ref] refs/pull/2443/head -> origin/pr/2443/head
* [new ref] refs/pull/2443/merge -> origin/pr/2443/merge
* [new ref] refs/pull/2444/head -> origin/pr/2444/head
* [new ref] refs/pull/2444/merge -> origin/pr/2444/merge
* [new ref] refs/pull/2445/head -> origin/pr/2445/head
* [new ref] refs/pull/2445/merge -> origin/pr/2445/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! e8a9669...e565b43 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 697b19fe5768cdc85aeaa54c425cb3a61a6167f4 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 697b19fe5768cdc85aeaa54c425cb3a61a6167f4
> git rev-list 3126df2b09c0641145777680be0540509b86d6f0 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6120553432275035057.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2964033570634022526.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1746354312376726049.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6221200945574730775.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-06 00:01:59,097 c145605c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c145605c/pkb.log
2017-04-06 00:01:59,097 c145605c MainThread INFO PerfKitBenchmarker version: v1.11.0-34-gb5bdefa
2017-04-06 00:01:59,097 c145605c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-06 00:01:59,574 c145605c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-06 00:01:59,703 c145605c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-06 00:01:59,705 c145605c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-06 00:01:59,705 c145605c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-06 00:01:59,710 c145605c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-06 00:01:59,712 c145605c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-06 00:01:59,740 c145605c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-06 00:01:59,740 c145605c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c145605c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #273
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/273/display/redirect?page=changes>
Changes:
[klk] Add windowing support to FileBasedSink
[tgroh] Add CreateViewWithViewFn PTransformMatcher
[chamikara] [BEAM-778] Make filesystem._CompressedFile seekable.
[robertwb] Update refcounts after pipeline reconstruction.
[robertwb] Revert "Add ValueProvider class for FileBasedSource I/O Transforms"
[tgroh] Add WindowMappingFn to PCollectionView
------------------------------------------
[...truncated 216.14 KB...]
x [deleted] (none) -> origin/pr/93/head
x [deleted] (none) -> origin/pr/930/head
x [deleted] (none) -> origin/pr/930/merge
x [deleted] (none) -> origin/pr/931/head
x [deleted] (none) -> origin/pr/931/merge
x [deleted] (none) -> origin/pr/932/head
x [deleted] (none) -> origin/pr/932/merge
x [deleted] (none) -> origin/pr/933/head
x [deleted] (none) -> origin/pr/933/merge
x [deleted] (none) -> origin/pr/934/head
x [deleted] (none) -> origin/pr/934/merge
x [deleted] (none) -> origin/pr/935/head
x [deleted] (none) -> origin/pr/936/head
x [deleted] (none) -> origin/pr/936/merge
x [deleted] (none) -> origin/pr/937/head
x [deleted] (none) -> origin/pr/937/merge
x [deleted] (none) -> origin/pr/938/head
x [deleted] (none) -> origin/pr/939/head
x [deleted] (none) -> origin/pr/94/head
x [deleted] (none) -> origin/pr/940/head
x [deleted] (none) -> origin/pr/940/merge
x [deleted] (none) -> origin/pr/941/head
x [deleted] (none) -> origin/pr/941/merge
x [deleted] (none) -> origin/pr/942/head
x [deleted] (none) -> origin/pr/942/merge
x [deleted] (none) -> origin/pr/943/head
x [deleted] (none) -> origin/pr/943/merge
x [deleted] (none) -> origin/pr/944/head
x [deleted] (none) -> origin/pr/945/head
x [deleted] (none) -> origin/pr/945/merge
x [deleted] (none) -> origin/pr/946/head
x [deleted] (none) -> origin/pr/946/merge
x [deleted] (none) -> origin/pr/947/head
x [deleted] (none) -> origin/pr/947/merge
x [deleted] (none) -> origin/pr/948/head
x [deleted] (none) -> origin/pr/948/merge
x [deleted] (none) -> origin/pr/949/head
x [deleted] (none) -> origin/pr/949/merge
x [deleted] (none) -> origin/pr/95/head
x [deleted] (none) -> origin/pr/95/merge
x [deleted] (none) -> origin/pr/950/head
x [deleted] (none) -> origin/pr/951/head
x [deleted] (none) -> origin/pr/951/merge
x [deleted] (none) -> origin/pr/952/head
x [deleted] (none) -> origin/pr/952/merge
x [deleted] (none) -> origin/pr/953/head
x [deleted] (none) -> origin/pr/954/head
x [deleted] (none) -> origin/pr/954/merge
x [deleted] (none) -> origin/pr/955/head
x [deleted] (none) -> origin/pr/955/merge
x [deleted] (none) -> origin/pr/956/head
x [deleted] (none) -> origin/pr/957/head
x [deleted] (none) -> origin/pr/958/head
x [deleted] (none) -> origin/pr/959/head
x [deleted] (none) -> origin/pr/959/merge
x [deleted] (none) -> origin/pr/96/head
x [deleted] (none) -> origin/pr/96/merge
x [deleted] (none) -> origin/pr/960/head
x [deleted] (none) -> origin/pr/960/merge
x [deleted] (none) -> origin/pr/961/head
x [deleted] (none) -> origin/pr/962/head
x [deleted] (none) -> origin/pr/962/merge
x [deleted] (none) -> origin/pr/963/head
x [deleted] (none) -> origin/pr/963/merge
x [deleted] (none) -> origin/pr/964/head
x [deleted] (none) -> origin/pr/965/head
x [deleted] (none) -> origin/pr/965/merge
x [deleted] (none) -> origin/pr/966/head
x [deleted] (none) -> origin/pr/967/head
x [deleted] (none) -> origin/pr/967/merge
x [deleted] (none) -> origin/pr/968/head
x [deleted] (none) -> origin/pr/968/merge
x [deleted] (none) -> origin/pr/969/head
x [deleted] (none) -> origin/pr/969/merge
x [deleted] (none) -> origin/pr/97/head
x [deleted] (none) -> origin/pr/97/merge
x [deleted] (none) -> origin/pr/970/head
x [deleted] (none) -> origin/pr/970/merge
x [deleted] (none) -> origin/pr/971/head
x [deleted] (none) -> origin/pr/971/merge
x [deleted] (none) -> origin/pr/972/head
x [deleted] (none) -> origin/pr/973/head
x [deleted] (none) -> origin/pr/974/head
x [deleted] (none) -> origin/pr/974/merge
x [deleted] (none) -> origin/pr/975/head
x [deleted] (none) -> origin/pr/975/merge
x [deleted] (none) -> origin/pr/976/head
x [deleted] (none) -> origin/pr/976/merge
x [deleted] (none) -> origin/pr/977/head
x [deleted] (none) -> origin/pr/977/merge
x [deleted] (none) -> origin/pr/978/head
x [deleted] (none) -> origin/pr/978/merge
x [deleted] (none) -> origin/pr/979/head
x [deleted] (none) -> origin/pr/979/merge
x [deleted] (none) -> origin/pr/98/head
x [deleted] (none) -> origin/pr/980/head
x [deleted] (none) -> origin/pr/980/merge
x [deleted] (none) -> origin/pr/981/head
x [deleted] (none) -> origin/pr/982/head
x [deleted] (none) -> origin/pr/982/merge
x [deleted] (none) -> origin/pr/983/head
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 3126df2b09c0641145777680be0540509b86d6f0 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 3126df2b09c0641145777680be0540509b86d6f0
> git rev-list 646cbdb7087fc68b7c2ff175ffbebac5f58688fd # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3104257587004707613.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1886745546054895691.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6360889297292637388.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8453970682472911331.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-05 18:02:12,222 148597f1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/148597f1/pkb.log
2017-04-05 18:02:12,222 148597f1 MainThread INFO PerfKitBenchmarker version: v1.11.0-33-g47c8402
2017-04-05 18:02:12,223 148597f1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-05 18:02:12,425 148597f1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-05 18:02:12,518 148597f1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-05 18:02:12,520 148597f1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-05 18:02:12,521 148597f1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-05 18:02:12,527 148597f1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-05 18:02:12,529 148597f1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-05 18:02:12,548 148597f1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-05 18:02:12,548 148597f1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/148597f1/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #272
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/272/display/redirect?page=changes>
Changes:
[staslevin] [BEAM-1777] In certain circumstances PipelineEnforcement shades
------------------------------------------
[...truncated 242.55 KB...]
* [new ref] refs/pull/2308/head -> origin/pr/2308/head
* [new ref] refs/pull/2308/merge -> origin/pr/2308/merge
* [new ref] refs/pull/2309/head -> origin/pr/2309/head
* [new ref] refs/pull/2309/merge -> origin/pr/2309/merge
* [new ref] refs/pull/2310/head -> origin/pr/2310/head
* [new ref] refs/pull/2310/merge -> origin/pr/2310/merge
* [new ref] refs/pull/2311/head -> origin/pr/2311/head
* [new ref] refs/pull/2311/merge -> origin/pr/2311/merge
* [new ref] refs/pull/2312/head -> origin/pr/2312/head
* [new ref] refs/pull/2312/merge -> origin/pr/2312/merge
* [new ref] refs/pull/2313/head -> origin/pr/2313/head
* [new ref] refs/pull/2313/merge -> origin/pr/2313/merge
* [new ref] refs/pull/2314/head -> origin/pr/2314/head
* [new ref] refs/pull/2314/merge -> origin/pr/2314/merge
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
* [new ref] refs/pull/2330/head -> origin/pr/2330/head
* [new ref] refs/pull/2330/merge -> origin/pr/2330/merge
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 15d3574...c2177a5 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! e6c8376...fa81767 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! 96939bb...8638950 refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 3dcf488...53d82f9 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 2dc209c...a22af37 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! d57e92f...b655148 refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 0a70afa...17f7bde refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! c2e0024...361609f refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2365/merge: No such file or directory
! 71c3124...5506f82 refs/pull/2365/merge -> origin/pr/2365/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2373/merge: No such file or directory
! dfab65f...b60fb4b refs/pull/2373/merge -> origin/pr/2373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! 42aec4e...028cbd0 refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 058d1c2...bb5dc71 refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/head: No such file or directory
! 2eea9ee..ebab092 refs/pull/2392/head -> origin/pr/2392/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! 95843c7...ad442ac refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! f907099...a45ae3c refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 64e8d25...f557728 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
* [new ref] refs/pull/2405/head -> origin/pr/2405/head
* [new ref] refs/pull/2405/merge -> origin/pr/2405/merge
* [new ref] refs/pull/2406/head -> origin/pr/2406/head
* [new ref] refs/pull/2406/merge -> origin/pr/2406/merge
* [new ref] refs/pull/2407/head -> origin/pr/2407/head
* [new ref] refs/pull/2407/merge -> origin/pr/2407/merge
* [new ref] refs/pull/2408/head -> origin/pr/2408/head
* [new ref] refs/pull/2408/merge -> origin/pr/2408/merge
* [new ref] refs/pull/2409/head -> origin/pr/2409/head
* [new ref] refs/pull/2409/merge -> origin/pr/2409/merge
* [new ref] refs/pull/2410/head -> origin/pr/2410/head
* [new ref] refs/pull/2410/merge -> origin/pr/2410/merge
* [new ref] refs/pull/2411/head -> origin/pr/2411/head
* [new ref] refs/pull/2411/merge -> origin/pr/2411/merge
* [new ref] refs/pull/2412/head -> origin/pr/2412/head
* [new ref] refs/pull/2412/merge -> origin/pr/2412/merge
* [new ref] refs/pull/2413/head -> origin/pr/2413/head
* [new ref] refs/pull/2413/merge -> origin/pr/2413/merge
* [new ref] refs/pull/2414/head -> origin/pr/2414/head
* [new ref] refs/pull/2414/merge -> origin/pr/2414/merge
* [new ref] refs/pull/2415/head -> origin/pr/2415/head
* [new ref] refs/pull/2415/merge -> origin/pr/2415/merge
* [new ref] refs/pull/2416/head -> origin/pr/2416/head
* [new ref] refs/pull/2417/head -> origin/pr/2417/head
* [new ref] refs/pull/2417/merge -> origin/pr/2417/merge
* [new ref] refs/pull/2418/head -> origin/pr/2418/head
* [new ref] refs/pull/2418/merge -> origin/pr/2418/merge
* [new ref] refs/pull/2419/head -> origin/pr/2419/head
* [new ref] refs/pull/2419/merge -> origin/pr/2419/merge
* [new ref] refs/pull/2420/head -> origin/pr/2420/head
* [new ref] refs/pull/2420/merge -> origin/pr/2420/merge
* [new ref] refs/pull/2421/head -> origin/pr/2421/head
* [new ref] refs/pull/2421/merge -> origin/pr/2421/merge
* [new ref] refs/pull/2422/head -> origin/pr/2422/head
* [new ref] refs/pull/2422/merge -> origin/pr/2422/merge
* [new ref] refs/pull/2423/head -> origin/pr/2423/head
* [new ref] refs/pull/2423/merge -> origin/pr/2423/merge
* [new ref] refs/pull/2424/head -> origin/pr/2424/head
* [new ref] refs/pull/2424/merge -> origin/pr/2424/merge
* [new ref] refs/pull/2425/head -> origin/pr/2425/head
* [new ref] refs/pull/2425/merge -> origin/pr/2425/merge
* [new ref] refs/pull/2426/head -> origin/pr/2426/head
* [new ref] refs/pull/2426/merge -> origin/pr/2426/merge
* [new ref] refs/pull/2427/head -> origin/pr/2427/head
* [new ref] refs/pull/2427/merge -> origin/pr/2427/merge
* [new ref] refs/pull/2428/head -> origin/pr/2428/head
* [new ref] refs/pull/2428/merge -> origin/pr/2428/merge
* [new ref] refs/pull/2429/head -> origin/pr/2429/head
* [new ref] refs/pull/2430/head -> origin/pr/2430/head
* [new ref] refs/pull/2430/merge -> origin/pr/2430/merge
* [new ref] refs/pull/2431/head -> origin/pr/2431/head
* [new ref] refs/pull/2431/merge -> origin/pr/2431/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 7168a0a...8e896c4 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 646cbdb7087fc68b7c2ff175ffbebac5f58688fd (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 646cbdb7087fc68b7c2ff175ffbebac5f58688fd
> git rev-list 6df661b0eb79acfae40898bdbaabc89ec66550ed # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1877273637109006624.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1498618782427127587.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson925609071973185335.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3035146247895910930.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-05 12:01:55,919 33752eef MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/33752eef/pkb.log
2017-04-05 12:01:55,919 33752eef MainThread INFO PerfKitBenchmarker version: v1.11.0-33-g47c8402
2017-04-05 12:01:55,920 33752eef MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-05 12:01:56,074 33752eef MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-05 12:01:56,156 33752eef MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-05 12:01:56,158 33752eef MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-05 12:01:56,158 33752eef MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-05 12:01:56,163 33752eef MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-05 12:01:56,165 33752eef MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-05 12:01:56,191 33752eef MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-05 12:01:56,192 33752eef MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/33752eef/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #271
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/271/display/redirect?page=changes>
Changes:
[altay] Do not have empty side input names
[altay] Add ValueProvider class for FileBasedSource I/O Transforms
------------------------------------------
[...truncated 244.53 KB...]
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
* [new ref] refs/pull/2330/head -> origin/pr/2330/head
* [new ref] refs/pull/2330/merge -> origin/pr/2330/merge
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! d894f10...15d3574 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 62f1891...e6c8376 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! 876daf6...96939bb refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! cc17eee...3dcf488 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2342/merge: No such file or directory
! 8f44b1d...a846f3e refs/pull/2342/merge -> origin/pr/2342/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 86def4a...2dc209c refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2350/merge: No such file or directory
! 14133e7...a2e4a5b refs/pull/2350/merge -> origin/pr/2350/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2352/merge: No such file or directory
! 7a8b036...6773c57 refs/pull/2352/merge -> origin/pr/2352/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! 44da66e...d57e92f refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 7a69a43...0a70afa refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 3e8f0e5...c2e0024 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 7518036...0a97f02 refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2373/merge: No such file or directory
! 03aa90c...dfab65f refs/pull/2373/merge -> origin/pr/2373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! 2576dd3...42aec4e refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! 7069b07...91bc5ed refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 77b0126...058d1c2 refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! c6332c3...e4daed3 refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2390/merge: No such file or directory
! 9a323a6...eda8375 refs/pull/2390/merge -> origin/pr/2390/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! 9441fdc...95843c7 refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/merge: No such file or directory
! c14ef59...e5a832c refs/pull/2393/merge -> origin/pr/2393/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! b9d15b6...f9e7b58 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! a30304e...bc2e859 refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! 8bfc91d...f907099 refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! 017cd5e...c1d3f4d refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! bc56b24...64e8d25 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
* [new ref] refs/pull/2405/head -> origin/pr/2405/head
* [new ref] refs/pull/2405/merge -> origin/pr/2405/merge
* [new ref] refs/pull/2406/head -> origin/pr/2406/head
* [new ref] refs/pull/2406/merge -> origin/pr/2406/merge
* [new ref] refs/pull/2407/head -> origin/pr/2407/head
* [new ref] refs/pull/2407/merge -> origin/pr/2407/merge
* [new ref] refs/pull/2408/head -> origin/pr/2408/head
* [new ref] refs/pull/2408/merge -> origin/pr/2408/merge
* [new ref] refs/pull/2409/head -> origin/pr/2409/head
* [new ref] refs/pull/2409/merge -> origin/pr/2409/merge
* [new ref] refs/pull/2410/head -> origin/pr/2410/head
* [new ref] refs/pull/2410/merge -> origin/pr/2410/merge
* [new ref] refs/pull/2411/head -> origin/pr/2411/head
* [new ref] refs/pull/2411/merge -> origin/pr/2411/merge
* [new ref] refs/pull/2412/head -> origin/pr/2412/head
* [new ref] refs/pull/2412/merge -> origin/pr/2412/merge
* [new ref] refs/pull/2413/head -> origin/pr/2413/head
* [new ref] refs/pull/2413/merge -> origin/pr/2413/merge
* [new ref] refs/pull/2414/head -> origin/pr/2414/head
* [new ref] refs/pull/2414/merge -> origin/pr/2414/merge
* [new ref] refs/pull/2415/head -> origin/pr/2415/head
* [new ref] refs/pull/2415/merge -> origin/pr/2415/merge
* [new ref] refs/pull/2416/head -> origin/pr/2416/head
* [new ref] refs/pull/2417/head -> origin/pr/2417/head
* [new ref] refs/pull/2417/merge -> origin/pr/2417/merge
* [new ref] refs/pull/2418/head -> origin/pr/2418/head
* [new ref] refs/pull/2418/merge -> origin/pr/2418/merge
* [new ref] refs/pull/2419/head -> origin/pr/2419/head
* [new ref] refs/pull/2419/merge -> origin/pr/2419/merge
* [new ref] refs/pull/2420/head -> origin/pr/2420/head
* [new ref] refs/pull/2420/merge -> origin/pr/2420/merge
* [new ref] refs/pull/2421/head -> origin/pr/2421/head
* [new ref] refs/pull/2421/merge -> origin/pr/2421/merge
* [new ref] refs/pull/2422/head -> origin/pr/2422/head
* [new ref] refs/pull/2422/merge -> origin/pr/2422/merge
* [new ref] refs/pull/2423/head -> origin/pr/2423/head
* [new ref] refs/pull/2423/merge -> origin/pr/2423/merge
* [new ref] refs/pull/2424/head -> origin/pr/2424/head
* [new ref] refs/pull/2424/merge -> origin/pr/2424/merge
* [new ref] refs/pull/2425/head -> origin/pr/2425/head
* [new ref] refs/pull/2425/merge -> origin/pr/2425/merge
* [new ref] refs/pull/2426/head -> origin/pr/2426/head
* [new ref] refs/pull/2426/merge -> origin/pr/2426/merge
* [new ref] refs/pull/2427/head -> origin/pr/2427/head
* [new ref] refs/pull/2427/merge -> origin/pr/2427/merge
* [new ref] refs/pull/2428/head -> origin/pr/2428/head
* [new ref] refs/pull/2428/merge -> origin/pr/2428/merge
* [new ref] refs/pull/2429/head -> origin/pr/2429/head
* [new ref] refs/pull/2430/head -> origin/pr/2430/head
* [new ref] refs/pull/2430/merge -> origin/pr/2430/merge
* [new ref] refs/pull/2431/head -> origin/pr/2431/head
* [new ref] refs/pull/2431/merge -> origin/pr/2431/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 930ba5d...7168a0a refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6df661b0eb79acfae40898bdbaabc89ec66550ed (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6df661b0eb79acfae40898bdbaabc89ec66550ed
> git rev-list 5eb78ae8a9300e555b7701f191dd3af490a4e77e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3319343631273619727.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1225365561892519404.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7674515569495455436.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5736423441376394937.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-05 06:01:52,167 9ce9fce7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/9ce9fce7/pkb.log
2017-04-05 06:01:52,167 9ce9fce7 MainThread INFO PerfKitBenchmarker version: v1.11.0-33-g47c8402
2017-04-05 06:01:52,168 9ce9fce7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-05 06:01:52,373 9ce9fce7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-05 06:01:52,464 9ce9fce7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-05 06:01:52,466 9ce9fce7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-05 06:01:52,466 9ce9fce7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-05 06:01:52,471 9ce9fce7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-05 06:01:52,473 9ce9fce7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-05 06:01:52,493 9ce9fce7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-05 06:01:52,494 9ce9fce7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/9ce9fce7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #270
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/270/display/redirect?page=changes>
Changes:
[robertwb] Avoid Runner API translation of pipelines with PDone.
[dhalperi] Change BigQueryIO.Write return type to allow for future new
[tgroh] Make Pubsub ackBatch safer
------------------------------------------
[...truncated 246.27 KB...]
! e8b05a0...62f1891 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! b28a70e...876daf6 refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! b70cb0a...cc17eee refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 6d667e5...86def4a refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2347/merge: No such file or directory
! 7bb2061...2207b92 refs/pull/2347/merge -> origin/pr/2347/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/merge: No such file or directory
! cafaf48...ec3e51d refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2350/merge: No such file or directory
! 894eb39...14133e7 refs/pull/2350/merge -> origin/pr/2350/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! 9edb8de...44da66e refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! af416dd...7a69a43 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2362/merge: No such file or directory
! ccf1604...d55e900 refs/pull/2362/merge -> origin/pr/2362/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! fb9f4ae...3e8f0e5 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/merge: No such file or directory
! 7ea16da...aa3817c refs/pull/2368/merge -> origin/pr/2368/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2370/merge: No such file or directory
! ae55810...5ab634f refs/pull/2370/merge -> origin/pr/2370/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2371/merge: No such file or directory
! 026c423...e551f52 refs/pull/2371/merge -> origin/pr/2371/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2372/merge: No such file or directory
! b7af200...24cda9d refs/pull/2372/merge -> origin/pr/2372/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2373/merge: No such file or directory
! 13e83d6...03aa90c refs/pull/2373/merge -> origin/pr/2373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/head: No such file or directory
! e09f88c...973a8c9 refs/pull/2377/head -> origin/pr/2377/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! f13f69c...2576dd3 refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2379/merge: No such file or directory
! b8da007...bd373f4 refs/pull/2379/merge -> origin/pr/2379/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! 8e47c1d...f9db63a refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! 7d7b1d7...1b76604 refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! 6e7d3fc...7069b07 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/head: No such file or directory
! 411f0fc...7916ece refs/pull/2383/head -> origin/pr/2383/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 067c42f...77b0126 refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! 3a5de28...7ffba0c refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2386/merge: No such file or directory
! 5103361...f857cb6 refs/pull/2386/merge -> origin/pr/2386/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! e69a83e...928a664 refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 4fd7f33...c6332c3 refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2390/merge: No such file or directory
! c3e0de0...9a323a6 refs/pull/2390/merge -> origin/pr/2390/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! c923943...9441fdc refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/merge: No such file or directory
! f192ff1...c14ef59 refs/pull/2393/merge -> origin/pr/2393/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/head: No such file or directory
! 3e64d9b...c32a470 refs/pull/2394/head -> origin/pr/2394/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 6e5babe...b9d15b6 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2395/merge: No such file or directory
! d781351...93cea42 refs/pull/2395/merge -> origin/pr/2395/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! 1d047a2...a30304e refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! 80d4ce5...8bfc91d refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! e478723...017cd5e refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 48b267f...bc56b24 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
error: unable to resolve reference refs/remotes/origin/pr/2404/merge: No such file or directory
! 03c0690...a2d92cb refs/pull/2404/merge -> origin/pr/2404/merge (unable to update local ref)
* [new ref] refs/pull/2405/head -> origin/pr/2405/head
* [new ref] refs/pull/2405/merge -> origin/pr/2405/merge
* [new ref] refs/pull/2406/head -> origin/pr/2406/head
* [new ref] refs/pull/2406/merge -> origin/pr/2406/merge
* [new ref] refs/pull/2407/head -> origin/pr/2407/head
* [new ref] refs/pull/2407/merge -> origin/pr/2407/merge
* [new ref] refs/pull/2408/head -> origin/pr/2408/head
* [new ref] refs/pull/2408/merge -> origin/pr/2408/merge
* [new ref] refs/pull/2409/head -> origin/pr/2409/head
* [new ref] refs/pull/2409/merge -> origin/pr/2409/merge
* [new ref] refs/pull/2410/head -> origin/pr/2410/head
* [new ref] refs/pull/2410/merge -> origin/pr/2410/merge
* [new ref] refs/pull/2411/head -> origin/pr/2411/head
* [new ref] refs/pull/2411/merge -> origin/pr/2411/merge
* [new ref] refs/pull/2412/head -> origin/pr/2412/head
* [new ref] refs/pull/2412/merge -> origin/pr/2412/merge
* [new ref] refs/pull/2413/head -> origin/pr/2413/head
* [new ref] refs/pull/2413/merge -> origin/pr/2413/merge
* [new ref] refs/pull/2414/head -> origin/pr/2414/head
* [new ref] refs/pull/2414/merge -> origin/pr/2414/merge
* [new ref] refs/pull/2415/head -> origin/pr/2415/head
* [new ref] refs/pull/2415/merge -> origin/pr/2415/merge
* [new ref] refs/pull/2416/head -> origin/pr/2416/head
* [new ref] refs/pull/2417/head -> origin/pr/2417/head
* [new ref] refs/pull/2417/merge -> origin/pr/2417/merge
* [new ref] refs/pull/2418/head -> origin/pr/2418/head
* [new ref] refs/pull/2418/merge -> origin/pr/2418/merge
* [new ref] refs/pull/2419/head -> origin/pr/2419/head
* [new ref] refs/pull/2419/merge -> origin/pr/2419/merge
* [new ref] refs/pull/2420/head -> origin/pr/2420/head
* [new ref] refs/pull/2420/merge -> origin/pr/2420/merge
* [new ref] refs/pull/2421/head -> origin/pr/2421/head
* [new ref] refs/pull/2421/merge -> origin/pr/2421/merge
* [new ref] refs/pull/2422/head -> origin/pr/2422/head
* [new ref] refs/pull/2422/merge -> origin/pr/2422/merge
* [new ref] refs/pull/2423/head -> origin/pr/2423/head
* [new ref] refs/pull/2423/merge -> origin/pr/2423/merge
* [new ref] refs/pull/2424/head -> origin/pr/2424/head
* [new ref] refs/pull/2424/merge -> origin/pr/2424/merge
* [new ref] refs/pull/2425/head -> origin/pr/2425/head
* [new ref] refs/pull/2425/merge -> origin/pr/2425/merge
* [new ref] refs/pull/2426/head -> origin/pr/2426/head
* [new ref] refs/pull/2426/merge -> origin/pr/2426/merge
* [new ref] refs/pull/2427/head -> origin/pr/2427/head
* [new ref] refs/pull/2427/merge -> origin/pr/2427/merge
* [new ref] refs/pull/2428/head -> origin/pr/2428/head
* [new ref] refs/pull/2428/merge -> origin/pr/2428/merge
* [new ref] refs/pull/2429/head -> origin/pr/2429/head
* [new ref] refs/pull/2429/merge -> origin/pr/2429/merge
* [new ref] refs/pull/2430/head -> origin/pr/2430/head
* [new ref] refs/pull/2430/merge -> origin/pr/2430/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 89ae7c9...930ba5d refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 5eb78ae8a9300e555b7701f191dd3af490a4e77e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 5eb78ae8a9300e555b7701f191dd3af490a4e77e
> git rev-list 22ff898a363715a99b19a75de416d62915681a23 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson57501518289503937.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8156403471324461439.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7130945948280506139.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson867595351560707213.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-05 00:01:55,780 97aea6bd MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/97aea6bd/pkb.log
2017-04-05 00:01:55,780 97aea6bd MainThread INFO PerfKitBenchmarker version: v1.11.0-33-g47c8402
2017-04-05 00:01:55,781 97aea6bd MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-05 00:01:56,046 97aea6bd MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-05 00:01:56,138 97aea6bd MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-05 00:01:56,140 97aea6bd MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-05 00:01:56,140 97aea6bd MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-05 00:01:56,145 97aea6bd MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-05 00:01:56,147 97aea6bd MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-05 00:01:56,167 97aea6bd MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-05 00:01:56,168 97aea6bd MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/97aea6bd/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #269
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/269/display/redirect?page=changes>
Changes:
[iemejia] [BEAM-1875] Remove Spark-runner-custom Hadoop and Avro IOs
[dhalperi] [BEAM-1550] Fix HBaseIO tests and change HBaseIO to use shaded
[dhalperi] [BEAM-1550] Enable parallel test execution for HBaseIO
[tgroh] Add GroupIntoBatches
[tgroh] Use Batch Replacement API in the Dataflow Runner
------------------------------------------
[...truncated 245.93 KB...]
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
* [new ref] refs/pull/2330/head -> origin/pr/2330/head
* [new ref] refs/pull/2330/merge -> origin/pr/2330/merge
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! c96be45...7771977 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 6ffc86c...e8b05a0 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! 0fe25a7...b28a70e refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 3d7ae3c...b70cb0a refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 6aa92f1...6d667e5 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2347/merge: No such file or directory
! f071213...7bb2061 refs/pull/2347/merge -> origin/pr/2347/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/merge: No such file or directory
! 820de53...cafaf48 refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! c420fe20...9edb8de refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2354/merge: No such file or directory
! 68e8856...468dcfc refs/pull/2354/merge -> origin/pr/2354/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2357/merge: No such file or directory
! 3fdd88c...a928d83 refs/pull/2357/merge -> origin/pr/2357/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 89b26cf...af416dd refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! c65ea2f...fb9f4ae refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2365/merge: No such file or directory
! 5c0bca0...71c3124 refs/pull/2365/merge -> origin/pr/2365/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/head: No such file or directory
! ff55571..83cda1f refs/pull/2368/head -> origin/pr/2368/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/merge: No such file or directory
! c56fab8...7ea16da refs/pull/2368/merge -> origin/pr/2368/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2370/merge: No such file or directory
! da2148a...ae55810 refs/pull/2370/merge -> origin/pr/2370/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2373/merge: No such file or directory
! 14f1a77...13e83d6 refs/pull/2373/merge -> origin/pr/2373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! a2e2fd2...f13f69c refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2378/merge: No such file or directory
! 8ac173c...6d02cef refs/pull/2378/merge -> origin/pr/2378/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2379/merge: No such file or directory
! 4053ffb...b8da007 refs/pull/2379/merge -> origin/pr/2379/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! 852569f...8e47c1d refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! 7fe946f...7d7b1d7 refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! 54b60cb...6e7d3fc refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/head: No such file or directory
! bc98123...411f0fc refs/pull/2383/head -> origin/pr/2383/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 9c0f2fc...067c42f refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! b08d0aa...3a5de28 refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2386/merge: No such file or directory
! a73472b...5103361 refs/pull/2386/merge -> origin/pr/2386/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! 8d8d266...e69a83e refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! ba37776...c923943 refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! cc201f8...6e5babe refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2395/merge: No such file or directory
! fb85dce...d781351 refs/pull/2395/merge -> origin/pr/2395/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2396/merge: No such file or directory
! 2aaf24d...e75ab84 refs/pull/2396/merge -> origin/pr/2396/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! 21bea33...1d047a2 refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! f90a860...80d4ce5 refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! 23adf06...e478723 refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! aed7324...48b267f refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
error: unable to resolve reference refs/remotes/origin/pr/2404/merge: No such file or directory
! 714be31...03c0690 refs/pull/2404/merge -> origin/pr/2404/merge (unable to update local ref)
* [new ref] refs/pull/2405/head -> origin/pr/2405/head
* [new ref] refs/pull/2405/merge -> origin/pr/2405/merge
* [new ref] refs/pull/2406/head -> origin/pr/2406/head
* [new ref] refs/pull/2406/merge -> origin/pr/2406/merge
* [new ref] refs/pull/2407/head -> origin/pr/2407/head
* [new ref] refs/pull/2407/merge -> origin/pr/2407/merge
* [new ref] refs/pull/2408/head -> origin/pr/2408/head
* [new ref] refs/pull/2408/merge -> origin/pr/2408/merge
* [new ref] refs/pull/2409/head -> origin/pr/2409/head
* [new ref] refs/pull/2409/merge -> origin/pr/2409/merge
* [new ref] refs/pull/2410/head -> origin/pr/2410/head
* [new ref] refs/pull/2410/merge -> origin/pr/2410/merge
* [new ref] refs/pull/2411/head -> origin/pr/2411/head
* [new ref] refs/pull/2411/merge -> origin/pr/2411/merge
* [new ref] refs/pull/2412/head -> origin/pr/2412/head
* [new ref] refs/pull/2412/merge -> origin/pr/2412/merge
* [new ref] refs/pull/2413/head -> origin/pr/2413/head
* [new ref] refs/pull/2413/merge -> origin/pr/2413/merge
* [new ref] refs/pull/2414/head -> origin/pr/2414/head
* [new ref] refs/pull/2414/merge -> origin/pr/2414/merge
* [new ref] refs/pull/2415/head -> origin/pr/2415/head
* [new ref] refs/pull/2416/head -> origin/pr/2416/head
* [new ref] refs/pull/2417/head -> origin/pr/2417/head
* [new ref] refs/pull/2417/merge -> origin/pr/2417/merge
* [new ref] refs/pull/2418/head -> origin/pr/2418/head
* [new ref] refs/pull/2418/merge -> origin/pr/2418/merge
* [new ref] refs/pull/2419/head -> origin/pr/2419/head
* [new ref] refs/pull/2419/merge -> origin/pr/2419/merge
* [new ref] refs/pull/2420/head -> origin/pr/2420/head
* [new ref] refs/pull/2420/merge -> origin/pr/2420/merge
* [new ref] refs/pull/2421/head -> origin/pr/2421/head
* [new ref] refs/pull/2421/merge -> origin/pr/2421/merge
* [new ref] refs/pull/2422/head -> origin/pr/2422/head
* [new ref] refs/pull/2422/merge -> origin/pr/2422/merge
* [new ref] refs/pull/2423/head -> origin/pr/2423/head
* [new ref] refs/pull/2423/merge -> origin/pr/2423/merge
* [new ref] refs/pull/2424/head -> origin/pr/2424/head
* [new ref] refs/pull/2424/merge -> origin/pr/2424/merge
* [new ref] refs/pull/2425/head -> origin/pr/2425/head
* [new ref] refs/pull/2425/merge -> origin/pr/2425/merge
* [new ref] refs/pull/2426/head -> origin/pr/2426/head
* [new ref] refs/pull/2426/merge -> origin/pr/2426/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 485bc8a...89ae7c9 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 22ff898a363715a99b19a75de416d62915681a23 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 22ff898a363715a99b19a75de416d62915681a23
> git rev-list cc8e0b9df1b54f1776fea6b7b593782b7e515ae5 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1823259324217632939.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson595535482093827853.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3785298746948146822.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5132002295084266764.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-04 18:02:09,839 16f35c4f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/16f35c4f/pkb.log
2017-04-04 18:02:09,839 16f35c4f MainThread INFO PerfKitBenchmarker version: v1.11.0-33-g47c8402
2017-04-04 18:02:09,840 16f35c4f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-04 18:02:10,067 16f35c4f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-04 18:02:10,158 16f35c4f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-04 18:02:10,161 16f35c4f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-04 18:02:10,162 16f35c4f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-04 18:02:10,168 16f35c4f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-04 18:02:10,171 16f35c4f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-04 18:02:10,192 16f35c4f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-04 18:02:10,193 16f35c4f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/16f35c4f/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #268
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/268/display/redirect?page=changes>
Changes:
[iemejia] Test waitUntilFinish(Duration) in the DirectRunner
[iemejia] Fix style on waitUntilFinish(Duration) test for the DirectRunner The
------------------------------------------
[...truncated 244.64 KB...]
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
* [new ref] refs/pull/2330/head -> origin/pr/2330/head
* [new ref] refs/pull/2330/merge -> origin/pr/2330/merge
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 528a938...c96be45 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 3705264...6ffc86c refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! 6c76db9...0fe25a7 refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 6cbf367...3d7ae3c refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! e9b5c5f...6aa92f1 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! ae334ac...c420fe20 refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 8272d2c...89b26cf refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 1d423d1...c65ea2f refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/merge: No such file or directory
! 0868a64...c56fab8 refs/pull/2368/merge -> origin/pr/2368/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2370/merge: No such file or directory
! b13cd99...da2148a refs/pull/2370/merge -> origin/pr/2370/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2373/merge: No such file or directory
! e6583fb...14f1a77 refs/pull/2373/merge -> origin/pr/2373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! 36ab131...a2e2fd2 refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2378/merge: No such file or directory
! 90e04b9...8ac173c refs/pull/2378/merge -> origin/pr/2378/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2379/merge: No such file or directory
! 11f43a0...4053ffb refs/pull/2379/merge -> origin/pr/2379/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! 971ba25...852569f refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! 0a185f3...7fe946f refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! aaac672...54b60cb refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 69e0d85...9c0f2fc refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! 699b4ee...b08d0aa refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2386/merge: No such file or directory
! 7fd2bbd...a73472b refs/pull/2386/merge -> origin/pr/2386/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! d3845bf...8d8d266 refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 524409e...4fd7f33 refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2390/merge: No such file or directory
! 0e882b2...c3e0de0 refs/pull/2390/merge -> origin/pr/2390/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! 0500764...ba37776 refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/merge: No such file or directory
! cc10473...f192ff1 refs/pull/2393/merge -> origin/pr/2393/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 17f60ed...cc201f8 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2395/merge: No such file or directory
! c78fa8f...fb85dce refs/pull/2395/merge -> origin/pr/2395/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2396/merge: No such file or directory
! 728ecfe...2aaf24d refs/pull/2396/merge -> origin/pr/2396/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! 9ba9be0...21bea33 refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! 7625801...f90a860 refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! bf414e9...23adf06 refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! bee2be6...aed7324 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
error: unable to resolve reference refs/remotes/origin/pr/2404/merge: No such file or directory
! 6afe000...714be31 refs/pull/2404/merge -> origin/pr/2404/merge (unable to update local ref)
* [new ref] refs/pull/2405/head -> origin/pr/2405/head
* [new ref] refs/pull/2405/merge -> origin/pr/2405/merge
* [new ref] refs/pull/2406/head -> origin/pr/2406/head
* [new ref] refs/pull/2406/merge -> origin/pr/2406/merge
* [new ref] refs/pull/2407/head -> origin/pr/2407/head
* [new ref] refs/pull/2407/merge -> origin/pr/2407/merge
* [new ref] refs/pull/2408/head -> origin/pr/2408/head
* [new ref] refs/pull/2408/merge -> origin/pr/2408/merge
* [new ref] refs/pull/2409/head -> origin/pr/2409/head
* [new ref] refs/pull/2409/merge -> origin/pr/2409/merge
* [new ref] refs/pull/2410/head -> origin/pr/2410/head
* [new ref] refs/pull/2410/merge -> origin/pr/2410/merge
* [new ref] refs/pull/2411/head -> origin/pr/2411/head
* [new ref] refs/pull/2411/merge -> origin/pr/2411/merge
* [new ref] refs/pull/2412/head -> origin/pr/2412/head
* [new ref] refs/pull/2412/merge -> origin/pr/2412/merge
* [new ref] refs/pull/2413/head -> origin/pr/2413/head
* [new ref] refs/pull/2413/merge -> origin/pr/2413/merge
* [new ref] refs/pull/2414/head -> origin/pr/2414/head
* [new ref] refs/pull/2414/merge -> origin/pr/2414/merge
* [new ref] refs/pull/2415/head -> origin/pr/2415/head
* [new ref] refs/pull/2416/head -> origin/pr/2416/head
* [new ref] refs/pull/2417/head -> origin/pr/2417/head
* [new ref] refs/pull/2417/merge -> origin/pr/2417/merge
* [new ref] refs/pull/2418/head -> origin/pr/2418/head
* [new ref] refs/pull/2418/merge -> origin/pr/2418/merge
* [new ref] refs/pull/2419/head -> origin/pr/2419/head
* [new ref] refs/pull/2419/merge -> origin/pr/2419/merge
* [new ref] refs/pull/2420/head -> origin/pr/2420/head
* [new ref] refs/pull/2420/merge -> origin/pr/2420/merge
* [new ref] refs/pull/2421/head -> origin/pr/2421/head
* [new ref] refs/pull/2421/merge -> origin/pr/2421/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 6ce2852...485bc8a refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision cc8e0b9df1b54f1776fea6b7b593782b7e515ae5 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f cc8e0b9df1b54f1776fea6b7b593782b7e515ae5
> git rev-list de36e8398ecb37b9826175c4723f94d127e63d03 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3748313950904058761.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8599696636826692174.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4195492670998390334.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson653803363962953568.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-04 12:03:30,803 db1612ad MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/db1612ad/pkb.log
2017-04-04 12:03:30,803 db1612ad MainThread INFO PerfKitBenchmarker version: v1.11.0-33-g47c8402
2017-04-04 12:03:30,804 db1612ad MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-04 12:03:31,183 db1612ad MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-04 12:03:31,272 db1612ad MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-04 12:03:31,275 db1612ad MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-04 12:03:31,275 db1612ad MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-04 12:03:31,281 db1612ad MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-04 12:03:31,283 db1612ad MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-04 12:03:31,303 db1612ad MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-04 12:03:31,303 db1612ad MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/db1612ad/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #267
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/267/display/redirect?page=changes>
Changes:
[tgroh] Remove GetProducingTransformInternal
[dhalperi] DataflowRunner: disable PAssert use of metrics when FnAPI is enabled
[wtanaka] Add example to BoundedCountingInput javadoc
------------------------------------------
[...truncated 241.44 KB...]
* [new ref] refs/pull/2298/head -> origin/pr/2298/head
* [new ref] refs/pull/2298/merge -> origin/pr/2298/merge
* [new ref] refs/pull/2299/head -> origin/pr/2299/head
* [new ref] refs/pull/2300/head -> origin/pr/2300/head
* [new ref] refs/pull/2300/merge -> origin/pr/2300/merge
* [new ref] refs/pull/2301/head -> origin/pr/2301/head
* [new ref] refs/pull/2301/merge -> origin/pr/2301/merge
* [new ref] refs/pull/2302/head -> origin/pr/2302/head
* [new ref] refs/pull/2303/head -> origin/pr/2303/head
* [new ref] refs/pull/2303/merge -> origin/pr/2303/merge
* [new ref] refs/pull/2304/head -> origin/pr/2304/head
* [new ref] refs/pull/2304/merge -> origin/pr/2304/merge
* [new ref] refs/pull/2305/head -> origin/pr/2305/head
* [new ref] refs/pull/2305/merge -> origin/pr/2305/merge
* [new ref] refs/pull/2306/head -> origin/pr/2306/head
* [new ref] refs/pull/2306/merge -> origin/pr/2306/merge
* [new ref] refs/pull/2307/head -> origin/pr/2307/head
* [new ref] refs/pull/2307/merge -> origin/pr/2307/merge
* [new ref] refs/pull/2308/head -> origin/pr/2308/head
* [new ref] refs/pull/2308/merge -> origin/pr/2308/merge
* [new ref] refs/pull/2309/head -> origin/pr/2309/head
* [new ref] refs/pull/2309/merge -> origin/pr/2309/merge
* [new ref] refs/pull/2310/head -> origin/pr/2310/head
* [new ref] refs/pull/2310/merge -> origin/pr/2310/merge
* [new ref] refs/pull/2311/head -> origin/pr/2311/head
* [new ref] refs/pull/2311/merge -> origin/pr/2311/merge
* [new ref] refs/pull/2312/head -> origin/pr/2312/head
* [new ref] refs/pull/2312/merge -> origin/pr/2312/merge
* [new ref] refs/pull/2313/head -> origin/pr/2313/head
* [new ref] refs/pull/2313/merge -> origin/pr/2313/merge
* [new ref] refs/pull/2314/head -> origin/pr/2314/head
* [new ref] refs/pull/2314/merge -> origin/pr/2314/merge
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
* [new ref] refs/pull/2330/head -> origin/pr/2330/head
* [new ref] refs/pull/2330/merge -> origin/pr/2330/merge
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 88043a0...528a938 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 3fee377...3705264 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! dafc583...6c76db9 refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 5dd5dd6...6cbf367 refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 7ac8828...e9b5c5f refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! d2f9da0...ae334ac refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! bac2186...8272d2c refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 7cc3f08...1d423d1 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/merge: No such file or directory
! 161dce1...0868a64 refs/pull/2368/merge -> origin/pr/2368/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2370/merge: No such file or directory
! 2b99954...b13cd99 refs/pull/2370/merge -> origin/pr/2370/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2373/merge: No such file or directory
! 082e803...e6583fb refs/pull/2373/merge -> origin/pr/2373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! 1e8cee9...36ab131 refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2379/merge: No such file or directory
! 036c3e3...11f43a0 refs/pull/2379/merge -> origin/pr/2379/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 92ae0f6...69e0d85 refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! acfb4fc...0500764 refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! d1c7efb...17f60ed refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! d3057d4...7625801 refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! 29b8174...bf414e9 refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! c10786d...bee2be6 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
error: unable to resolve reference refs/remotes/origin/pr/2404/merge: No such file or directory
! e0eb00b...6afe000 refs/pull/2404/merge -> origin/pr/2404/merge (unable to update local ref)
* [new ref] refs/pull/2405/head -> origin/pr/2405/head
* [new ref] refs/pull/2405/merge -> origin/pr/2405/merge
* [new ref] refs/pull/2406/head -> origin/pr/2406/head
* [new ref] refs/pull/2406/merge -> origin/pr/2406/merge
* [new ref] refs/pull/2407/head -> origin/pr/2407/head
* [new ref] refs/pull/2407/merge -> origin/pr/2407/merge
* [new ref] refs/pull/2408/head -> origin/pr/2408/head
* [new ref] refs/pull/2408/merge -> origin/pr/2408/merge
* [new ref] refs/pull/2409/head -> origin/pr/2409/head
* [new ref] refs/pull/2409/merge -> origin/pr/2409/merge
* [new ref] refs/pull/2410/head -> origin/pr/2410/head
* [new ref] refs/pull/2410/merge -> origin/pr/2410/merge
* [new ref] refs/pull/2411/head -> origin/pr/2411/head
* [new ref] refs/pull/2411/merge -> origin/pr/2411/merge
* [new ref] refs/pull/2412/head -> origin/pr/2412/head
* [new ref] refs/pull/2412/merge -> origin/pr/2412/merge
* [new ref] refs/pull/2413/head -> origin/pr/2413/head
* [new ref] refs/pull/2413/merge -> origin/pr/2413/merge
* [new ref] refs/pull/2414/head -> origin/pr/2414/head
* [new ref] refs/pull/2414/merge -> origin/pr/2414/merge
* [new ref] refs/pull/2415/head -> origin/pr/2415/head
* [new ref] refs/pull/2416/head -> origin/pr/2416/head
* [new ref] refs/pull/2417/head -> origin/pr/2417/head
* [new ref] refs/pull/2417/merge -> origin/pr/2417/merge
* [new ref] refs/pull/2418/head -> origin/pr/2418/head
* [new ref] refs/pull/2418/merge -> origin/pr/2418/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 7fb3fb9...6ce2852 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision de36e8398ecb37b9826175c4723f94d127e63d03 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f de36e8398ecb37b9826175c4723f94d127e63d03
> git rev-list 844e53e341bf6d465e4185903a3a5047a3e68282 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson698338798145135765.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9094320473531368186.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5932982161029851858.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8786768405224854856.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-04 06:01:55,505 c20d98a7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c20d98a7/pkb.log
2017-04-04 06:01:55,506 c20d98a7 MainThread INFO PerfKitBenchmarker version: v1.11.0-33-g47c8402
2017-04-04 06:01:55,506 c20d98a7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-04 06:01:55,624 c20d98a7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-04 06:01:55,713 c20d98a7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-04 06:01:55,715 c20d98a7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-04 06:01:55,716 c20d98a7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-04 06:01:55,721 c20d98a7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-04 06:01:55,724 c20d98a7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-04 06:01:55,747 c20d98a7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-04 06:01:55,747 c20d98a7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c20d98a7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #266
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/266/display/redirect?page=changes>
Changes:
[tgroh] Remove Direct Runner "doneness" configuration
[tgroh] Use Batch Replacement in the Flink Runner
[klk] JavaDoc for function `PaneInfo.getTiming()`
[altay] [BEAM-1719] Remove test modules from PyDoc
[altay] Update PR template with correct ICLA link
[altay] Update integration tests in post commits
[dhalperi] DataflowRunner: automatically determine container image type
------------------------------------------
[...truncated 245.60 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2346/merge: No such file or directory
! 63fb4e9...1afc8c3 refs/pull/2346/merge -> origin/pr/2346/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2347/merge: No such file or directory
! 20602a3...f071213 refs/pull/2347/merge -> origin/pr/2347/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/merge: No such file or directory
! d4bc004...820de53 refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2350/merge: No such file or directory
! 01b49d6...894eb39 refs/pull/2350/merge -> origin/pr/2350/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2351/merge: No such file or directory
! 92c78c6...662028f refs/pull/2351/merge -> origin/pr/2351/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2352/merge: No such file or directory
! 1a629a1...7a8b036 refs/pull/2352/merge -> origin/pr/2352/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! 9850fc7...d2f9da0 refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2354/merge: No such file or directory
! 336d9b1...68e8856 refs/pull/2354/merge -> origin/pr/2354/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2355/merge: No such file or directory
! ab11836...db7d4c9 refs/pull/2355/merge -> origin/pr/2355/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2357/merge: No such file or directory
! 9757a3b...3fdd88c refs/pull/2357/merge -> origin/pr/2357/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! c8e4eaf...bac2186 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2362/merge: No such file or directory
! 4be97f9...ccf1604 refs/pull/2362/merge -> origin/pr/2362/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! bd21625...7cc3f08 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2364/merge: No such file or directory
! f2158bf...75c86de refs/pull/2364/merge -> origin/pr/2364/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2365/merge: No such file or directory
! f6e645a...5c0bca0 refs/pull/2365/merge -> origin/pr/2365/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2366/merge: No such file or directory
! cbe91db...d6cb85e refs/pull/2366/merge -> origin/pr/2366/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 6f12eb1...7518036 refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/merge: No such file or directory
! 98a4c84...161dce1 refs/pull/2368/merge -> origin/pr/2368/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2369/merge: No such file or directory
! 1f792b0...a10c8c8 refs/pull/2369/merge -> origin/pr/2369/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2370/merge: No such file or directory
! e5062cd...2b99954 refs/pull/2370/merge -> origin/pr/2370/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2371/merge: No such file or directory
! 6f1bba9...026c423 refs/pull/2371/merge -> origin/pr/2371/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2372/merge: No such file or directory
! a2d2759...b7af200 refs/pull/2372/merge -> origin/pr/2372/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2373/merge: No such file or directory
! cc49cff...082e803 refs/pull/2373/merge -> origin/pr/2373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2374/head: No such file or directory
! 9041213...6a7b85a refs/pull/2374/head -> origin/pr/2374/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2374/merge: No such file or directory
! e3f2de6...ef31596 refs/pull/2374/merge -> origin/pr/2374/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2375/merge: No such file or directory
! 81f255a...0883a61 refs/pull/2375/merge -> origin/pr/2375/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2376/merge: No such file or directory
! f7bb050...6c54337 refs/pull/2376/merge -> origin/pr/2376/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! 65e0e0a...1e8cee9 refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2378/merge: No such file or directory
! f4f1b66...90e04b9 refs/pull/2378/merge -> origin/pr/2378/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2379/head: No such file or directory
! 446d6c3...27f1548 refs/pull/2379/head -> origin/pr/2379/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2379/merge: No such file or directory
! 696bc7a...036c3e3 refs/pull/2379/merge -> origin/pr/2379/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! 635adb5...971ba25 refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! faa0480...0a185f3 refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! c7687b3...aaac672 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! a88e8ea...92ae0f6 refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! 9adcfee...699b4ee refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2386/merge: No such file or directory
! fddf539...7fd2bbd refs/pull/2386/merge -> origin/pr/2386/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! fce8be9...d3845bf refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 8629f0b...524409e refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2390/merge: No such file or directory
! 41a400a...0e882b2 refs/pull/2390/merge -> origin/pr/2390/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! d124c45...acfb4fc refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/head: No such file or directory
! 1b69613...54aa977 refs/pull/2393/head -> origin/pr/2393/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/merge: No such file or directory
! 686f5e6...cc10473 refs/pull/2393/merge -> origin/pr/2393/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 89b9ecc...d1c7efb refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2395/merge: No such file or directory
! 5496022...c78fa8f refs/pull/2395/merge -> origin/pr/2395/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2396/merge: No such file or directory
! 53f07ab...728ecfe refs/pull/2396/merge -> origin/pr/2396/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! c19f805...9ba9be0 refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! c2c35b2...d3057d4 refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! d951391...29b8174 refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 9b00192...c10786d refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2402/merge -> origin/pr/2402/merge
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
error: unable to resolve reference refs/remotes/origin/pr/2404/head: No such file or directory
! c3ecbd3..2c54655 refs/pull/2404/head -> origin/pr/2404/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2404/merge: No such file or directory
! 63e609f...e0eb00b refs/pull/2404/merge -> origin/pr/2404/merge (unable to update local ref)
* [new ref] refs/pull/2405/head -> origin/pr/2405/head
* [new ref] refs/pull/2405/merge -> origin/pr/2405/merge
* [new ref] refs/pull/2406/head -> origin/pr/2406/head
* [new ref] refs/pull/2406/merge -> origin/pr/2406/merge
* [new ref] refs/pull/2407/head -> origin/pr/2407/head
* [new ref] refs/pull/2407/merge -> origin/pr/2407/merge
* [new ref] refs/pull/2408/head -> origin/pr/2408/head
* [new ref] refs/pull/2408/merge -> origin/pr/2408/merge
* [new ref] refs/pull/2409/head -> origin/pr/2409/head
* [new ref] refs/pull/2409/merge -> origin/pr/2409/merge
* [new ref] refs/pull/2410/head -> origin/pr/2410/head
* [new ref] refs/pull/2410/merge -> origin/pr/2410/merge
* [new ref] refs/pull/2411/head -> origin/pr/2411/head
* [new ref] refs/pull/2411/merge -> origin/pr/2411/merge
* [new ref] refs/pull/2412/head -> origin/pr/2412/head
* [new ref] refs/pull/2412/merge -> origin/pr/2412/merge
* [new ref] refs/pull/2413/head -> origin/pr/2413/head
* [new ref] refs/pull/2413/merge -> origin/pr/2413/merge
* [new ref] refs/pull/2414/head -> origin/pr/2414/head
* [new ref] refs/pull/2414/merge -> origin/pr/2414/merge
* [new ref] refs/pull/2415/head -> origin/pr/2415/head
* [new ref] refs/pull/2416/head -> origin/pr/2416/head
* [new ref] refs/pull/2416/merge -> origin/pr/2416/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 2de1e81...7fb3fb9 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 844e53e341bf6d465e4185903a3a5047a3e68282 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 844e53e341bf6d465e4185903a3a5047a3e68282
> git rev-list af8f586b60853056a20b08d88f7dca72eac657bc # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4334672978531800956.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4563039396419307862.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8760251365109031500.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6184132374196384430.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-04 00:02:06,341 737ed8f9 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/737ed8f9/pkb.log
2017-04-04 00:02:06,342 737ed8f9 MainThread INFO PerfKitBenchmarker version: v1.11.0-33-g47c8402
2017-04-04 00:02:06,342 737ed8f9 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-04 00:02:06,818 737ed8f9 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-04 00:02:06,910 737ed8f9 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-04 00:02:06,913 737ed8f9 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-04 00:02:06,913 737ed8f9 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-04 00:02:06,918 737ed8f9 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-04 00:02:06,921 737ed8f9 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-04 00:02:06,943 737ed8f9 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-04 00:02:06,944 737ed8f9 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/737ed8f9/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #265
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/265/display/redirect?page=changes>
Changes:
[tgroh] Add a Dataflow-specific primitive for creating a view
[chamikara] [BEAM-1684] Add unit tests for iobase.py.
------------------------------------------
[...truncated 246.69 KB...]
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
* [new ref] refs/pull/2330/head -> origin/pr/2330/head
* [new ref] refs/pull/2330/merge -> origin/pr/2330/merge
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 7fedd0a...d44ccb5 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2332/merge: No such file or directory
! bbdc3c1...fb960a9 refs/pull/2332/merge -> origin/pr/2332/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2336/merge: No such file or directory
! 88fff5a...9cf36c3 refs/pull/2336/merge -> origin/pr/2336/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 1aea6d0...0816e7d refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! bf84e36...446f6aa refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! eb9f8da...83b8e8b refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! d3ab6db...7282547 refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2347/merge: No such file or directory
! 2eb4d69...20602a3 refs/pull/2347/merge -> origin/pr/2347/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/head: No such file or directory
! b1fd848..cdcf1ba refs/pull/2348/head -> origin/pr/2348/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/merge: No such file or directory
! 59e9738...d4bc004 refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2351/merge: No such file or directory
! 0d32abe...92c78c6 refs/pull/2351/merge -> origin/pr/2351/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! 28e8a5e...9850fc7 refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 7f5f21c...c8e4eaf refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2362/merge: No such file or directory
! 5d7e258...4be97f9 refs/pull/2362/merge -> origin/pr/2362/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 965634f...bd21625 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2364/merge: No such file or directory
! cc775dc...f2158bf refs/pull/2364/merge -> origin/pr/2364/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2365/merge: No such file or directory
! 954a152...f6e645a refs/pull/2365/merge -> origin/pr/2365/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2366/merge: No such file or directory
! 35e0380...cbe91db refs/pull/2366/merge -> origin/pr/2366/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! a29603b...6f12eb1 refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/merge: No such file or directory
! 3878f42...98a4c84 refs/pull/2368/merge -> origin/pr/2368/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2369/merge: No such file or directory
! d061997...1f792b0 refs/pull/2369/merge -> origin/pr/2369/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2370/merge: No such file or directory
! ee3161a...e5062cd refs/pull/2370/merge -> origin/pr/2370/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2371/merge: No such file or directory
! 2755cd3...6f1bba9 refs/pull/2371/merge -> origin/pr/2371/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2372/merge: No such file or directory
! 0bacdfb...a2d2759 refs/pull/2372/merge -> origin/pr/2372/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2373/merge: No such file or directory
! 97ba513...cc49cff refs/pull/2373/merge -> origin/pr/2373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2374/merge: No such file or directory
! 9a4eaf3...e3f2de6 refs/pull/2374/merge -> origin/pr/2374/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2375/merge: No such file or directory
! b8a74f8...81f255a refs/pull/2375/merge -> origin/pr/2375/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2376/merge: No such file or directory
! dca2c95...f7bb050 refs/pull/2376/merge -> origin/pr/2376/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! cb39ec8...65e0e0a refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2378/merge: No such file or directory
! 8161e45...f4f1b66 refs/pull/2378/merge -> origin/pr/2378/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2379/head: No such file or directory
! 29ffe5e...446d6c3 refs/pull/2379/head -> origin/pr/2379/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2379/merge: No such file or directory
! a57f5b3...696bc7a refs/pull/2379/merge -> origin/pr/2379/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/head: No such file or directory
! 5883f00...2cb9d36 refs/pull/2380/head -> origin/pr/2380/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2380/merge: No such file or directory
! 6bd4868...635adb5 refs/pull/2380/merge -> origin/pr/2380/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! 898cabd...faa0480 refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! fabb377...c7687b3 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/head: No such file or directory
! 6fc3600...bc98123 refs/pull/2383/head -> origin/pr/2383/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 55ea1d2...a88e8ea refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! ff5d210...9adcfee refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2386/merge: No such file or directory
! e6b7b46...fddf539 refs/pull/2386/merge -> origin/pr/2386/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! 3c9afe3...fce8be9 refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 330af10...8629f0b refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2390/merge: No such file or directory
! 1f33455...41a400a refs/pull/2390/merge -> origin/pr/2390/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! 3536ad8...d124c45 refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/merge: No such file or directory
! e7e4404...686f5e6 refs/pull/2393/merge -> origin/pr/2393/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 9a05091...89b9ecc refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2395/merge: No such file or directory
! d503d42...5496022 refs/pull/2395/merge -> origin/pr/2395/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2396/merge: No such file or directory
! 8f98def...53f07ab refs/pull/2396/merge -> origin/pr/2396/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/head: No such file or directory
! 8c8c480...9763c1d refs/pull/2397/head -> origin/pr/2397/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! 3c41d98...c19f805 refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! f5e1cb3...c2c35b2 refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! 9e4c8a3...d951391 refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! 6454b1c...9b00192 refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2402/merge -> origin/pr/2402/merge
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
error: unable to resolve reference refs/remotes/origin/pr/2404/head: No such file or directory
! b1c5ef1..c3ecbd3 refs/pull/2404/head -> origin/pr/2404/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2404/merge: No such file or directory
! 901f995...63e609f refs/pull/2404/merge -> origin/pr/2404/merge (unable to update local ref)
* [new ref] refs/pull/2405/head -> origin/pr/2405/head
* [new ref] refs/pull/2405/merge -> origin/pr/2405/merge
* [new ref] refs/pull/2406/head -> origin/pr/2406/head
* [new ref] refs/pull/2406/merge -> origin/pr/2406/merge
* [new ref] refs/pull/2407/head -> origin/pr/2407/head
* [new ref] refs/pull/2407/merge -> origin/pr/2407/merge
* [new ref] refs/pull/2408/head -> origin/pr/2408/head
* [new ref] refs/pull/2408/merge -> origin/pr/2408/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! 288d37e...2de1e81 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/900/merge: No such file or directory
! d5dd848...31b1716 refs/pull/900/merge -> origin/pr/900/merge (unable to update local ref)
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision af8f586b60853056a20b08d88f7dca72eac657bc (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f af8f586b60853056a20b08d88f7dca72eac657bc
> git rev-list fe1d4124e7d51ec45869fb9e95cc8243f5891553 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9144547388431687884.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson169674622076397791.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3001447939654638215.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3264589722486959485.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-03 18:02:12,797 f84f2fb5 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/f84f2fb5/pkb.log
2017-04-03 18:02:12,798 f84f2fb5 MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-03 18:02:12,798 f84f2fb5 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-03 18:02:13,196 f84f2fb5 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-03 18:02:13,280 f84f2fb5 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-03 18:02:13,283 f84f2fb5 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-03 18:02:13,283 f84f2fb5 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-03 18:02:13,288 f84f2fb5 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-03 18:02:13,290 f84f2fb5 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-03 18:02:13,316 f84f2fb5 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-03 18:02:13,316 f84f2fb5 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/f84f2fb5/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #264
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/264/display/redirect>
------------------------------------------
[...truncated 237.41 KB...]
* [new ref] refs/pull/2291/merge -> origin/pr/2291/merge
* [new ref] refs/pull/2292/head -> origin/pr/2292/head
* [new ref] refs/pull/2292/merge -> origin/pr/2292/merge
* [new ref] refs/pull/2293/head -> origin/pr/2293/head
* [new ref] refs/pull/2293/merge -> origin/pr/2293/merge
* [new ref] refs/pull/2294/head -> origin/pr/2294/head
* [new ref] refs/pull/2294/merge -> origin/pr/2294/merge
* [new ref] refs/pull/2295/head -> origin/pr/2295/head
* [new ref] refs/pull/2295/merge -> origin/pr/2295/merge
* [new ref] refs/pull/2296/head -> origin/pr/2296/head
* [new ref] refs/pull/2296/merge -> origin/pr/2296/merge
* [new ref] refs/pull/2297/head -> origin/pr/2297/head
* [new ref] refs/pull/2297/merge -> origin/pr/2297/merge
* [new ref] refs/pull/2298/head -> origin/pr/2298/head
* [new ref] refs/pull/2298/merge -> origin/pr/2298/merge
* [new ref] refs/pull/2299/head -> origin/pr/2299/head
* [new ref] refs/pull/2300/head -> origin/pr/2300/head
* [new ref] refs/pull/2300/merge -> origin/pr/2300/merge
* [new ref] refs/pull/2301/head -> origin/pr/2301/head
* [new ref] refs/pull/2301/merge -> origin/pr/2301/merge
* [new ref] refs/pull/2302/head -> origin/pr/2302/head
* [new ref] refs/pull/2303/head -> origin/pr/2303/head
* [new ref] refs/pull/2303/merge -> origin/pr/2303/merge
* [new ref] refs/pull/2304/head -> origin/pr/2304/head
* [new ref] refs/pull/2304/merge -> origin/pr/2304/merge
* [new ref] refs/pull/2305/head -> origin/pr/2305/head
* [new ref] refs/pull/2305/merge -> origin/pr/2305/merge
* [new ref] refs/pull/2306/head -> origin/pr/2306/head
* [new ref] refs/pull/2306/merge -> origin/pr/2306/merge
* [new ref] refs/pull/2307/head -> origin/pr/2307/head
* [new ref] refs/pull/2307/merge -> origin/pr/2307/merge
* [new ref] refs/pull/2308/head -> origin/pr/2308/head
* [new ref] refs/pull/2308/merge -> origin/pr/2308/merge
* [new ref] refs/pull/2309/head -> origin/pr/2309/head
* [new ref] refs/pull/2309/merge -> origin/pr/2309/merge
* [new ref] refs/pull/2310/head -> origin/pr/2310/head
* [new ref] refs/pull/2310/merge -> origin/pr/2310/merge
* [new ref] refs/pull/2311/head -> origin/pr/2311/head
* [new ref] refs/pull/2311/merge -> origin/pr/2311/merge
* [new ref] refs/pull/2312/head -> origin/pr/2312/head
* [new ref] refs/pull/2312/merge -> origin/pr/2312/merge
* [new ref] refs/pull/2313/head -> origin/pr/2313/head
* [new ref] refs/pull/2313/merge -> origin/pr/2313/merge
* [new ref] refs/pull/2314/head -> origin/pr/2314/head
* [new ref] refs/pull/2314/merge -> origin/pr/2314/merge
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
* [new ref] refs/pull/2330/head -> origin/pr/2330/head
* [new ref] refs/pull/2330/merge -> origin/pr/2330/merge
error: unable to resolve reference refs/remotes/origin/pr/2362/merge: No such file or directory
! b97a244...5d7e258 refs/pull/2362/merge -> origin/pr/2362/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2364/merge: No such file or directory
! 90d9098...cc775dc refs/pull/2364/merge -> origin/pr/2364/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2365/merge: No such file or directory
! 9941e40...954a152 refs/pull/2365/merge -> origin/pr/2365/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2366/merge: No such file or directory
! 663ab60...35e0380 refs/pull/2366/merge -> origin/pr/2366/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! 1f16e85...a29603b refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2369/merge: No such file or directory
! 4951883...d061997 refs/pull/2369/merge -> origin/pr/2369/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2371/merge: No such file or directory
! cab0440...2755cd3 refs/pull/2371/merge -> origin/pr/2371/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2372/merge: No such file or directory
! 2476679...0bacdfb refs/pull/2372/merge -> origin/pr/2372/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2375/merge: No such file or directory
! f971b81...b8a74f8 refs/pull/2375/merge -> origin/pr/2375/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2376/merge: No such file or directory
! d8aa25a...dca2c95 refs/pull/2376/merge -> origin/pr/2376/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2378/merge: No such file or directory
! cab3d4b...8161e45 refs/pull/2378/merge -> origin/pr/2378/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2381/merge: No such file or directory
! 2cd9dcb...898cabd refs/pull/2381/merge -> origin/pr/2381/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2382/merge: No such file or directory
! b0dc8b4...fabb377 refs/pull/2382/merge -> origin/pr/2382/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/head: No such file or directory
! c08cbbb...6fc3600 refs/pull/2383/head -> origin/pr/2383/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 5144fcd...55ea1d2 refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2385/merge: No such file or directory
! 0413d1f...ff5d210 refs/pull/2385/merge -> origin/pr/2385/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2386/merge: No such file or directory
! acccce6...e6b7b46 refs/pull/2386/merge -> origin/pr/2386/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2389/merge: No such file or directory
! 86cb0c1...330af10 refs/pull/2389/merge -> origin/pr/2389/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2390/merge: No such file or directory
! ff4a99a...1f33455 refs/pull/2390/merge -> origin/pr/2390/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/head: No such file or directory
! 9870ab0..2eea9ee refs/pull/2392/head -> origin/pr/2392/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! 84da07c...3536ad8 refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2395/merge: No such file or directory
! e19307c...d503d42 refs/pull/2395/merge -> origin/pr/2395/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2396/merge: No such file or directory
! 7f342c1...8f98def refs/pull/2396/merge -> origin/pr/2396/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/head: No such file or directory
! 126397b...8c8c480 refs/pull/2397/head -> origin/pr/2397/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! 74a004f...3c41d98 refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2402/merge -> origin/pr/2402/merge
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
* [new ref] refs/pull/2405/head -> origin/pr/2405/head
* [new ref] refs/pull/2405/merge -> origin/pr/2405/merge
* [new ref] refs/pull/2406/head -> origin/pr/2406/head
* [new ref] refs/pull/2406/merge -> origin/pr/2406/merge
Auto packing the repository for optimum performance. You may also
run "git gc" manually. See "git help gc" for more information.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fe1d4124e7d51ec45869fb9e95cc8243f5891553 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fe1d4124e7d51ec45869fb9e95cc8243f5891553
> git rev-list fe1d4124e7d51ec45869fb9e95cc8243f5891553 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6933032652395710508.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6350463689927388309.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1375578584955633303.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7236534446955651839.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-03 12:02:43,041 51f37513 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/51f37513/pkb.log
2017-04-03 12:02:43,042 51f37513 MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-03 12:02:43,042 51f37513 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-03 12:02:43,385 51f37513 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-03 12:02:43,510 51f37513 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-03 12:02:43,512 51f37513 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-03 12:02:43,513 51f37513 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-03 12:02:43,521 51f37513 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-03 12:02:43,524 51f37513 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-03 12:02:43,556 51f37513 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-03 12:02:43,557 51f37513 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/51f37513/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #263
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/263/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fe1d4124e7d51ec45869fb9e95cc8243f5891553 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fe1d4124e7d51ec45869fb9e95cc8243f5891553
> git rev-list fe1d4124e7d51ec45869fb9e95cc8243f5891553 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5510274784474074819.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson456671033743452463.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8849750461786029142.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1494488639103816340.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-03 06:00:50,987 cf222548 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/cf222548/pkb.log
2017-04-03 06:00:50,987 cf222548 MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-03 06:00:50,988 cf222548 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-03 06:00:51,263 cf222548 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-03 06:00:51,383 cf222548 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-03 06:00:51,386 cf222548 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-03 06:00:51,387 cf222548 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-03 06:00:51,394 cf222548 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-03 06:00:51,396 cf222548 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-03 06:00:51,451 cf222548 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-03 06:00:51,452 cf222548 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/cf222548/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #262
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/262/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fe1d4124e7d51ec45869fb9e95cc8243f5891553 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fe1d4124e7d51ec45869fb9e95cc8243f5891553
> git rev-list fe1d4124e7d51ec45869fb9e95cc8243f5891553 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6512253486991864100.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7385739790240899376.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5191121802013883002.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3439536893932770801.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-03 00:01:56,243 acc615e0 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/acc615e0/pkb.log
2017-04-03 00:01:56,244 acc615e0 MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-03 00:01:56,244 acc615e0 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-03 00:01:56,435 acc615e0 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-03 00:01:56,521 acc615e0 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-03 00:01:56,523 acc615e0 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-03 00:01:56,524 acc615e0 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-03 00:01:56,529 acc615e0 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-03 00:01:56,532 acc615e0 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-03 00:01:56,557 acc615e0 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-03 00:01:56,558 acc615e0 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/acc615e0/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #261
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/261/display/redirect>
------------------------------------------
[...truncated 221.39 KB...]
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1096, done.
remote: Compressing objects: 2% (1/44) remote: Compressing objects: 4% (2/44) remote: Compressing objects: 6% (3/44) remote: Compressing objects: 9% (4/44) remote: Compressing objects: 11% (5/44) remote: Compressing objects: 13% (6/44) remote: Compressing objects: 15% (7/44) remote: Compressing objects: 18% (8/44) remote: Compressing objects: 20% (9/44) remote: Compressing objects: 22% (10/44) remote: Compressing objects: 25% (11/44) remote: Compressing objects: 27% (12/44) remote: Compressing objects: 29% (13/44) remote: Compressing objects: 31% (14/44) remote: Compressing objects: 34% (15/44) remote: Compressing objects: 36% (16/44) remote: Compressing objects: 38% (17/44) remote: Compressing objects: 40% (18/44) remote: Compressing objects: 43% (19/44) remote: Compressing objects: 45% (20/44) remote: Compressing objects: 47% (21/44) remote: Compressing objects: 50% (22/44) remote: Compressing objects: 52% (23/44) remote: Compressing objects: 54% (24/44) remote: Compressing objects: 56% (25/44) remote: Compressing objects: 59% (26/44) remote: Compressing objects: 61% (27/44) remote: Compressing objects: 63% (28/44) remote: Compressing objects: 65% (29/44) remote: Compressing objects: 68% (30/44) remote: Compressing objects: 70% (31/44) remote: Compressing objects: 72% (32/44) remote: Compressing objects: 75% (33/44) remote: Compressing objects: 77% (34/44) remote: Compressing objects: 79% (35/44) remote: Compressing objects: 81% (36/44) remote: Compressing objects: 84% (37/44) remote: Compressing objects: 86% (38/44) remote: Compressing objects: 88% (39/44) remote: Compressing objects: 90% (40/44) remote: Compressing objects: 93% (41/44) remote: Compressing objects: 95% (42/44) remote: Compressing objects: 97% (43/44) remote: Compressing objects: 100% (44/44) remote: Compressing objects: 100% (44/44), done.
Receiving objects: 0% (1/1096) Receiving objects: 1% (11/1096) Receiving objects: 2% (22/1096) Receiving objects: 3% (33/1096) Receiving objects: 4% (44/1096) Receiving objects: 5% (55/1096) Receiving objects: 6% (66/1096) Receiving objects: 7% (77/1096) Receiving objects: 8% (88/1096) Receiving objects: 9% (99/1096) Receiving objects: 10% (110/1096) Receiving objects: 11% (121/1096) Receiving objects: 12% (132/1096) Receiving objects: 13% (143/1096) Receiving objects: 14% (154/1096) Receiving objects: 15% (165/1096) Receiving objects: 16% (176/1096) Receiving objects: 17% (187/1096) Receiving objects: 18% (198/1096) Receiving objects: 19% (209/1096) Receiving objects: 20% (220/1096) Receiving objects: 21% (231/1096) Receiving objects: 22% (242/1096) Receiving objects: 23% (253/1096) Receiving objects: 24% (264/1096) Receiving objects: 25% (274/1096) Receiving objects: 26% (285/1096) Receiving objects: 27% (296/1096) Receiving objects: 28% (307/1096) Receiving objects: 29% (318/1096) Receiving objects: 30% (329/1096) Receiving objects: 31% (340/1096) Receiving objects: 32% (351/1096) Receiving objects: 33% (362/1096) Receiving objects: 34% (373/1096) Receiving objects: 35% (384/1096) Receiving objects: 36% (395/1096) Receiving objects: 37% (406/1096) Receiving objects: 38% (417/1096) Receiving objects: 39% (428/1096) Receiving objects: 40% (439/1096) Receiving objects: 41% (450/1096) Receiving objects: 42% (461/1096) Receiving objects: 43% (472/1096) Receiving objects: 44% (483/1096) Receiving objects: 45% (494/1096) Receiving objects: 46% (505/1096) Receiving objects: 47% (516/1096) Receiving objects: 48% (527/1096) Receiving objects: 49% (538/1096) Receiving objects: 50% (548/1096) Receiving objects: 51% (559/1096) Receiving objects: 52% (570/1096) Receiving objects: 53% (581/1096) Receiving objects: 54% (592/1096) Receiving objects: 55% (603/1096) Receiving objects: 56% (614/1096) Receiving objects: 57% (625/1096) Receiving objects: 58% (636/1096) Receiving objects: 59% (647/1096) Receiving objects: 60% (658/1096) Receiving objects: 61% (669/1096) Receiving objects: 62% (680/1096) Receiving objects: 63% (691/1096) Receiving objects: 64% (702/1096) Receiving objects: 65% (713/1096) Receiving objects: 66% (724/1096) Receiving objects: 67% (735/1096) Receiving objects: 68% (746/1096) Receiving objects: 69% (757/1096) Receiving objects: 70% (768/1096) Receiving objects: 71% (779/1096) Receiving objects: 72% (790/1096) Receiving objects: 73% (801/1096) Receiving objects: 74% (812/1096) Receiving objects: 75% (822/1096) Receiving objects: 76% (833/1096) Receiving objects: 77% (844/1096) Receiving objects: 78% (855/1096) Receiving objects: 79% (866/1096) Receiving objects: 80% (877/1096) Receiving objects: 81% (888/1096) Receiving objects: 82% (899/1096) Receiving objects: 83% (910/1096) Receiving objects: 84% (921/1096) Receiving objects: 85% (932/1096) Receiving objects: 86% (943/1096) Receiving objects: 87% (954/1096) Receiving objects: 88% (965/1096) Receiving objects: 89% (976/1096) Receiving objects: 90% (987/1096) Receiving objects: 91% (998/1096) Receiving objects: 92% (1009/1096) Receiving objects: 93% (1020/1096) Receiving objects: 94% (1031/1096) Receiving objects: 95% (1042/1096) remote: Total 1096 (delta 461), reused 452 (delta 452), pack-reused 588
Receiving objects: 96% (1053/1096) Receiving objects: 97% (1064/1096) Receiving objects: 98% (1075/1096) Receiving objects: 99% (1086/1096) Receiving objects: 100% (1096/1096) Receiving objects: 100% (1096/1096), 168.26 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/482) Resolving deltas: 1% (6/482) Resolving deltas: 2% (10/482) Resolving deltas: 3% (15/482) Resolving deltas: 4% (20/482) Resolving deltas: 5% (27/482) Resolving deltas: 6% (29/482) Resolving deltas: 8% (43/482) Resolving deltas: 9% (48/482) Resolving deltas: 12% (58/482) Resolving deltas: 13% (64/482) Resolving deltas: 15% (73/482) Resolving deltas: 16% (79/482) Resolving deltas: 18% (90/482) Resolving deltas: 21% (102/482) Resolving deltas: 22% (110/482) Resolving deltas: 23% (112/482) Resolving deltas: 24% (117/482) Resolving deltas: 25% (121/482) Resolving deltas: 26% (129/482) Resolving deltas: 27% (131/482) Resolving deltas: 28% (135/482) Resolving deltas: 29% (140/482) Resolving deltas: 30% (145/482) Resolving deltas: 31% (151/482) Resolving deltas: 32% (157/482) Resolving deltas: 33% (160/482) Resolving deltas: 34% (165/482) Resolving deltas: 35% (169/482) Resolving deltas: 36% (174/482) Resolving deltas: 37% (180/482) Resolving deltas: 38% (184/482) Resolving deltas: 39% (191/482) Resolving deltas: 40% (196/482) Resolving deltas: 42% (205/482) Resolving deltas: 44% (213/482) Resolving deltas: 45% (218/482) Resolving deltas: 46% (222/482) Resolving deltas: 47% (228/482) Resolving deltas: 48% (233/482) Resolving deltas: 49% (237/482) Resolving deltas: 50% (242/482) Resolving deltas: 51% (247/482) Resolving deltas: 52% (251/482) Resolving deltas: 53% (257/482) Resolving deltas: 54% (261/482) Resolving deltas: 55% (269/482) Resolving deltas: 56% (270/482) Resolving deltas: 57% (278/482) Resolving deltas: 58% (280/482) Resolving deltas: 59% (286/482) Resolving deltas: 60% (290/482) Resolving deltas: 61% (296/482) Resolving deltas: 62% (299/482) Resolving deltas: 63% (304/482) Resolving deltas: 65% (314/482) Resolving deltas: 66% (319/482) Resolving deltas: 67% (324/482) Resolving deltas: 68% (332/482) Resolving deltas: 70% (338/482) Resolving deltas: 71% (343/482) Resolving deltas: 72% (349/482) Resolving deltas: 73% (352/482) Resolving deltas: 74% (357/482) Resolving deltas: 75% (362/482) Resolving deltas: 76% (367/482) Resolving deltas: 77% (373/482) Resolving deltas: 78% (377/482) Resolving deltas: 79% (381/482) Resolving deltas: 80% (386/482) Resolving deltas: 81% (391/482) Resolving deltas: 82% (396/482) Resolving deltas: 83% (401/482) Resolving deltas: 84% (407/482) Resolving deltas: 85% (411/482) Resolving deltas: 86% (417/482) Resolving deltas: 87% (420/482) Resolving deltas: 88% (425/482) Resolving deltas: 89% (430/482) Resolving deltas: 90% (434/482) Resolving deltas: 91% (439/482) Resolving deltas: 92% (444/482) Resolving deltas: 93% (449/482) Resolving deltas: 94% (454/482) Resolving deltas: 95% (458/482) Resolving deltas: 96% (463/482) Resolving deltas: 97% (470/482) Resolving deltas: 98% (473/482) Resolving deltas: 99% (478/482) Resolving deltas: 100% (482/482) Resolving deltas: 100% (482/482), completed with 236 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2235/merge: No such file or directory
! 612284b...c0ce6e9 refs/pull/2235/merge -> origin/pr/2235/merge (unable to update local ref)
* [new ref] refs/pull/2283/head -> origin/pr/2283/head
* [new ref] refs/pull/2283/merge -> origin/pr/2283/merge
* [new ref] refs/pull/2284/head -> origin/pr/2284/head
* [new ref] refs/pull/2284/merge -> origin/pr/2284/merge
* [new ref] refs/pull/2285/head -> origin/pr/2285/head
* [new ref] refs/pull/2285/merge -> origin/pr/2285/merge
* [new ref] refs/pull/2286/head -> origin/pr/2286/head
* [new ref] refs/pull/2286/merge -> origin/pr/2286/merge
* [new ref] refs/pull/2287/head -> origin/pr/2287/head
* [new ref] refs/pull/2287/merge -> origin/pr/2287/merge
* [new ref] refs/pull/2288/head -> origin/pr/2288/head
* [new ref] refs/pull/2288/merge -> origin/pr/2288/merge
* [new ref] refs/pull/2289/head -> origin/pr/2289/head
* [new ref] refs/pull/2289/merge -> origin/pr/2289/merge
* [new ref] refs/pull/2290/head -> origin/pr/2290/head
* [new ref] refs/pull/2290/merge -> origin/pr/2290/merge
* [new ref] refs/pull/2291/head -> origin/pr/2291/head
* [new ref] refs/pull/2291/merge -> origin/pr/2291/merge
* [new ref] refs/pull/2292/head -> origin/pr/2292/head
* [new ref] refs/pull/2292/merge -> origin/pr/2292/merge
* [new ref] refs/pull/2293/head -> origin/pr/2293/head
* [new ref] refs/pull/2293/merge -> origin/pr/2293/merge
* [new ref] refs/pull/2294/head -> origin/pr/2294/head
* [new ref] refs/pull/2294/merge -> origin/pr/2294/merge
* [new ref] refs/pull/2295/head -> origin/pr/2295/head
* [new ref] refs/pull/2295/merge -> origin/pr/2295/merge
* [new ref] refs/pull/2296/head -> origin/pr/2296/head
* [new ref] refs/pull/2296/merge -> origin/pr/2296/merge
* [new ref] refs/pull/2297/head -> origin/pr/2297/head
* [new ref] refs/pull/2297/merge -> origin/pr/2297/merge
* [new ref] refs/pull/2298/head -> origin/pr/2298/head
* [new ref] refs/pull/2298/merge -> origin/pr/2298/merge
* [new ref] refs/pull/2299/head -> origin/pr/2299/head
* [new ref] refs/pull/2300/head -> origin/pr/2300/head
* [new ref] refs/pull/2300/merge -> origin/pr/2300/merge
* [new ref] refs/pull/2301/head -> origin/pr/2301/head
* [new ref] refs/pull/2301/merge -> origin/pr/2301/merge
* [new ref] refs/pull/2302/head -> origin/pr/2302/head
* [new ref] refs/pull/2303/head -> origin/pr/2303/head
* [new ref] refs/pull/2303/merge -> origin/pr/2303/merge
* [new ref] refs/pull/2304/head -> origin/pr/2304/head
* [new ref] refs/pull/2304/merge -> origin/pr/2304/merge
* [new ref] refs/pull/2305/head -> origin/pr/2305/head
* [new ref] refs/pull/2305/merge -> origin/pr/2305/merge
* [new ref] refs/pull/2306/head -> origin/pr/2306/head
* [new ref] refs/pull/2306/merge -> origin/pr/2306/merge
* [new ref] refs/pull/2307/head -> origin/pr/2307/head
* [new ref] refs/pull/2307/merge -> origin/pr/2307/merge
* [new ref] refs/pull/2308/head -> origin/pr/2308/head
* [new ref] refs/pull/2308/merge -> origin/pr/2308/merge
* [new ref] refs/pull/2309/head -> origin/pr/2309/head
* [new ref] refs/pull/2309/merge -> origin/pr/2309/merge
* [new ref] refs/pull/2310/head -> origin/pr/2310/head
* [new ref] refs/pull/2310/merge -> origin/pr/2310/merge
* [new ref] refs/pull/2311/head -> origin/pr/2311/head
* [new ref] refs/pull/2311/merge -> origin/pr/2311/merge
* [new ref] refs/pull/2312/head -> origin/pr/2312/head
* [new ref] refs/pull/2312/merge -> origin/pr/2312/merge
* [new ref] refs/pull/2313/head -> origin/pr/2313/head
* [new ref] refs/pull/2313/merge -> origin/pr/2313/merge
* [new ref] refs/pull/2314/head -> origin/pr/2314/head
* [new ref] refs/pull/2314/merge -> origin/pr/2314/merge
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
* [new ref] refs/pull/2330/head -> origin/pr/2330/head
* [new ref] refs/pull/2330/merge -> origin/pr/2330/merge
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2402/merge -> origin/pr/2402/merge
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fe1d4124e7d51ec45869fb9e95cc8243f5891553 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fe1d4124e7d51ec45869fb9e95cc8243f5891553
> git rev-list fe1d4124e7d51ec45869fb9e95cc8243f5891553 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5098677740131167598.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2137487830432010039.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3905998182985512631.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8222481557773709417.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-02 18:02:59,214 6457ea76 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/6457ea76/pkb.log
2017-04-02 18:02:59,215 6457ea76 MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-02 18:02:59,215 6457ea76 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-02 18:02:59,649 6457ea76 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-02 18:02:59,772 6457ea76 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-02 18:02:59,774 6457ea76 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-02 18:02:59,774 6457ea76 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-02 18:02:59,780 6457ea76 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-02 18:02:59,782 6457ea76 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-02 18:02:59,807 6457ea76 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-02 18:02:59,808 6457ea76 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/6457ea76/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #260
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/260/display/redirect?page=changes>
Changes:
[staslevin] [BEAM-1048] Added a read duration metric to SparkUnboundedSource.
------------------------------------------
[...truncated 240.24 KB...]
* [new ref] refs/pull/2289/head -> origin/pr/2289/head
* [new ref] refs/pull/2289/merge -> origin/pr/2289/merge
* [new ref] refs/pull/2290/head -> origin/pr/2290/head
* [new ref] refs/pull/2290/merge -> origin/pr/2290/merge
* [new ref] refs/pull/2291/head -> origin/pr/2291/head
* [new ref] refs/pull/2291/merge -> origin/pr/2291/merge
* [new ref] refs/pull/2292/head -> origin/pr/2292/head
* [new ref] refs/pull/2292/merge -> origin/pr/2292/merge
* [new ref] refs/pull/2293/head -> origin/pr/2293/head
* [new ref] refs/pull/2293/merge -> origin/pr/2293/merge
* [new ref] refs/pull/2294/head -> origin/pr/2294/head
* [new ref] refs/pull/2294/merge -> origin/pr/2294/merge
* [new ref] refs/pull/2295/head -> origin/pr/2295/head
* [new ref] refs/pull/2295/merge -> origin/pr/2295/merge
* [new ref] refs/pull/2296/head -> origin/pr/2296/head
* [new ref] refs/pull/2296/merge -> origin/pr/2296/merge
* [new ref] refs/pull/2297/head -> origin/pr/2297/head
* [new ref] refs/pull/2297/merge -> origin/pr/2297/merge
* [new ref] refs/pull/2298/head -> origin/pr/2298/head
* [new ref] refs/pull/2298/merge -> origin/pr/2298/merge
* [new ref] refs/pull/2299/head -> origin/pr/2299/head
* [new ref] refs/pull/2300/head -> origin/pr/2300/head
* [new ref] refs/pull/2300/merge -> origin/pr/2300/merge
* [new ref] refs/pull/2301/head -> origin/pr/2301/head
* [new ref] refs/pull/2301/merge -> origin/pr/2301/merge
* [new ref] refs/pull/2302/head -> origin/pr/2302/head
* [new ref] refs/pull/2303/head -> origin/pr/2303/head
* [new ref] refs/pull/2303/merge -> origin/pr/2303/merge
* [new ref] refs/pull/2304/head -> origin/pr/2304/head
* [new ref] refs/pull/2304/merge -> origin/pr/2304/merge
* [new ref] refs/pull/2305/head -> origin/pr/2305/head
* [new ref] refs/pull/2305/merge -> origin/pr/2305/merge
* [new ref] refs/pull/2306/head -> origin/pr/2306/head
* [new ref] refs/pull/2306/merge -> origin/pr/2306/merge
* [new ref] refs/pull/2307/head -> origin/pr/2307/head
* [new ref] refs/pull/2307/merge -> origin/pr/2307/merge
* [new ref] refs/pull/2308/head -> origin/pr/2308/head
* [new ref] refs/pull/2308/merge -> origin/pr/2308/merge
* [new ref] refs/pull/2309/head -> origin/pr/2309/head
* [new ref] refs/pull/2309/merge -> origin/pr/2309/merge
* [new ref] refs/pull/2310/head -> origin/pr/2310/head
* [new ref] refs/pull/2310/merge -> origin/pr/2310/merge
* [new ref] refs/pull/2311/head -> origin/pr/2311/head
* [new ref] refs/pull/2311/merge -> origin/pr/2311/merge
* [new ref] refs/pull/2312/head -> origin/pr/2312/head
* [new ref] refs/pull/2312/merge -> origin/pr/2312/merge
* [new ref] refs/pull/2313/head -> origin/pr/2313/head
* [new ref] refs/pull/2313/merge -> origin/pr/2313/merge
* [new ref] refs/pull/2314/head -> origin/pr/2314/head
* [new ref] refs/pull/2314/merge -> origin/pr/2314/merge
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
* [new ref] refs/pull/2330/head -> origin/pr/2330/head
* [new ref] refs/pull/2330/merge -> origin/pr/2330/merge
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 322f51b...7fedd0a refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2332/merge: No such file or directory
! f930d52...bbdc3c1 refs/pull/2332/merge -> origin/pr/2332/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 1044817...d115fd8 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! fb5aa47...bf84e36 refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! 8543078...eb9f8da refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! 28b2027...d3ab6db refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/merge: No such file or directory
! 634fa63...59e9738 refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! b2794ca...28e8a5e refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! fcb0f63...7f5f21c refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! 4a81b38...965634f refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/merge: No such file or directory
! fbbbdad...3878f42 refs/pull/2368/merge -> origin/pr/2368/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2370/merge: No such file or directory
! 5c2b637...ee3161a refs/pull/2370/merge -> origin/pr/2370/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2373/merge: No such file or directory
! 79eddac...97ba513 refs/pull/2373/merge -> origin/pr/2373/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2374/merge: No such file or directory
! f65bb61...9a4eaf3 refs/pull/2374/merge -> origin/pr/2374/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2377/merge: No such file or directory
! 3715df6...cb39ec8 refs/pull/2377/merge -> origin/pr/2377/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2379/merge: No such file or directory
! cde923f...a57f5b3 refs/pull/2379/merge -> origin/pr/2379/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2383/merge: No such file or directory
! 0704ee9...5144fcd refs/pull/2383/merge -> origin/pr/2383/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2387/merge: No such file or directory
! 4adca5a...3c9afe3 refs/pull/2387/merge -> origin/pr/2387/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2392/merge: No such file or directory
! 1ce02b1...84da07c refs/pull/2392/merge -> origin/pr/2392/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2393/merge: No such file or directory
! f64e15b...e7e4404 refs/pull/2393/merge -> origin/pr/2393/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2394/merge: No such file or directory
! 299e0c9...9a05091 refs/pull/2394/merge -> origin/pr/2394/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2397/merge: No such file or directory
! 6774f0f...74a004f refs/pull/2397/merge -> origin/pr/2397/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2399/merge: No such file or directory
! b533387...f5e1cb3 refs/pull/2399/merge -> origin/pr/2399/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2400/merge: No such file or directory
! f074ce5...9e4c8a3 refs/pull/2400/merge -> origin/pr/2400/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2401/merge: No such file or directory
! e554983...6454b1c refs/pull/2401/merge -> origin/pr/2401/merge (unable to update local ref)
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2402/merge -> origin/pr/2402/merge
* [new ref] refs/pull/2403/head -> origin/pr/2403/head
* [new ref] refs/pull/2403/merge -> origin/pr/2403/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! bb50f07...288d37e refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fe1d4124e7d51ec45869fb9e95cc8243f5891553 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fe1d4124e7d51ec45869fb9e95cc8243f5891553
> git rev-list ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4166500153080564986.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3214431254764796879.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2694744271804441873.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6176905655245048031.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-02 12:02:03,461 3cfc9bd1 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3cfc9bd1/pkb.log
2017-04-02 12:02:03,461 3cfc9bd1 MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-02 12:02:03,462 3cfc9bd1 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-02 12:02:03,714 3cfc9bd1 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-02 12:02:03,799 3cfc9bd1 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-02 12:02:03,802 3cfc9bd1 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-02 12:02:03,802 3cfc9bd1 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-02 12:02:03,810 3cfc9bd1 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-02 12:02:03,812 3cfc9bd1 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-02 12:02:03,839 3cfc9bd1 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-02 12:02:03,840 3cfc9bd1 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3cfc9bd1/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #259
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/259/display/redirect>
------------------------------------------
[...truncated 221.39 KB...]
x [deleted] (none) -> origin/pr/983/merge
x [deleted] (none) -> origin/pr/984/head
x [deleted] (none) -> origin/pr/984/merge
x [deleted] (none) -> origin/pr/985/head
x [deleted] (none) -> origin/pr/985/merge
x [deleted] (none) -> origin/pr/986/head
x [deleted] (none) -> origin/pr/986/merge
x [deleted] (none) -> origin/pr/987/head
x [deleted] (none) -> origin/pr/988/head
x [deleted] (none) -> origin/pr/988/merge
x [deleted] (none) -> origin/pr/989/head
x [deleted] (none) -> origin/pr/989/merge
x [deleted] (none) -> origin/pr/99/head
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1047, done.
remote: Compressing objects: 2% (1/36) remote: Compressing objects: 5% (2/36) remote: Compressing objects: 8% (3/36) remote: Compressing objects: 11% (4/36) remote: Compressing objects: 13% (5/36) remote: Compressing objects: 16% (6/36) remote: Compressing objects: 19% (7/36) remote: Compressing objects: 22% (8/36) remote: Compressing objects: 25% (9/36) remote: Compressing objects: 27% (10/36) remote: Compressing objects: 30% (11/36) remote: Compressing objects: 33% (12/36) remote: Compressing objects: 36% (13/36) remote: Compressing objects: 38% (14/36) remote: Compressing objects: 41% (15/36) remote: Compressing objects: 44% (16/36) remote: Compressing objects: 47% (17/36) remote: Compressing objects: 50% (18/36) remote: Compressing objects: 52% (19/36) remote: Compressing objects: 55% (20/36) remote: Compressing objects: 58% (21/36) remote: Compressing objects: 61% (22/36) remote: Compressing objects: 63% (23/36) remote: Compressing objects: 66% (24/36) remote: Compressing objects: 69% (25/36) remote: Compressing objects: 72% (26/36) remote: Compressing objects: 75% (27/36) remote: Compressing objects: 77% (28/36) remote: Compressing objects: 80% (29/36) remote: Compressing objects: 83% (30/36) remote: Compressing objects: 86% (31/36) remote: Compressing objects: 88% (32/36) remote: Compressing objects: 91% (33/36) remote: Compressing objects: 94% (34/36) remote: Compressing objects: 97% (35/36) remote: Compressing objects: 100% (36/36) remote: Compressing objects: 100% (36/36), done.
Receiving objects: 0% (1/1047) Receiving objects: 1% (11/1047) Receiving objects: 2% (21/1047) Receiving objects: 3% (32/1047) Receiving objects: 4% (42/1047) Receiving objects: 5% (53/1047) Receiving objects: 6% (63/1047) Receiving objects: 7% (74/1047) Receiving objects: 8% (84/1047) Receiving objects: 9% (95/1047) Receiving objects: 10% (105/1047) Receiving objects: 11% (116/1047) Receiving objects: 12% (126/1047) Receiving objects: 13% (137/1047) Receiving objects: 14% (147/1047) Receiving objects: 15% (158/1047) Receiving objects: 16% (168/1047) Receiving objects: 17% (178/1047) Receiving objects: 18% (189/1047) Receiving objects: 19% (199/1047) Receiving objects: 20% (210/1047) Receiving objects: 21% (220/1047) Receiving objects: 22% (231/1047) Receiving objects: 23% (241/1047) Receiving objects: 24% (252/1047) Receiving objects: 25% (262/1047) Receiving objects: 26% (273/1047) Receiving objects: 27% (283/1047) Receiving objects: 28% (294/1047) Receiving objects: 29% (304/1047) Receiving objects: 30% (315/1047) Receiving objects: 31% (325/1047) Receiving objects: 32% (336/1047) Receiving objects: 33% (346/1047) Receiving objects: 34% (356/1047) Receiving objects: 35% (367/1047) Receiving objects: 36% (377/1047) Receiving objects: 37% (388/1047) Receiving objects: 38% (398/1047) Receiving objects: 39% (409/1047) Receiving objects: 40% (419/1047) Receiving objects: 41% (430/1047) Receiving objects: 42% (440/1047) Receiving objects: 43% (451/1047) Receiving objects: 44% (461/1047) Receiving objects: 45% (472/1047) Receiving objects: 46% (482/1047) Receiving objects: 47% (493/1047) Receiving objects: 48% (503/1047) Receiving objects: 49% (514/1047) Receiving objects: 50% (524/1047) Receiving objects: 51% (534/1047) Receiving objects: 52% (545/1047) Receiving objects: 53% (555/1047) Receiving objects: 54% (566/1047) Receiving objects: 55% (576/1047) Receiving objects: 56% (587/1047) Receiving objects: 57% (597/1047) Receiving objects: 58% (608/1047) Receiving objects: 59% (618/1047) Receiving objects: 60% (629/1047) Receiving objects: 61% (639/1047) Receiving objects: 62% (650/1047) Receiving objects: 63% (660/1047) Receiving objects: 64% (671/1047) Receiving objects: 65% (681/1047) Receiving objects: 66% (692/1047) Receiving objects: 67% (702/1047) Receiving objects: 68% (712/1047) Receiving objects: 69% (723/1047) Receiving objects: 70% (733/1047) Receiving objects: 71% (744/1047) Receiving objects: 72% (754/1047) Receiving objects: 73% (765/1047) Receiving objects: 74% (775/1047) Receiving objects: 75% (786/1047) Receiving objects: 76% (796/1047) Receiving objects: 77% (807/1047) Receiving objects: 78% (817/1047) Receiving objects: 79% (828/1047) Receiving objects: 80% (838/1047) Receiving objects: 81% (849/1047) Receiving objects: 82% (859/1047) Receiving objects: 83% (870/1047) Receiving objects: 84% (880/1047) Receiving objects: 85% (890/1047) Receiving objects: 86% (901/1047) Receiving objects: 87% (911/1047) Receiving objects: 88% (922/1047) Receiving objects: 89% (932/1047) Receiving objects: 90% (943/1047) Receiving objects: 91% (953/1047) Receiving objects: 92% (964/1047) Receiving objects: 93% (974/1047) Receiving objects: 94% (985/1047) remote: Total 1047 (delta 443), reused 437 (delta 437), pack-reused 564
Receiving objects: 95% (995/1047) Receiving objects: 96% (1006/1047) Receiving objects: 97% (1016/1047) Receiving objects: 98% (1027/1047) Receiving objects: 99% (1037/1047) Receiving objects: 100% (1047/1047) Receiving objects: 100% (1047/1047), 154.91 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/464) Resolving deltas: 1% (6/464) Resolving deltas: 2% (10/464) Resolving deltas: 3% (14/464) Resolving deltas: 4% (20/464) Resolving deltas: 5% (26/464) Resolving deltas: 6% (28/464) Resolving deltas: 8% (40/464) Resolving deltas: 9% (45/464) Resolving deltas: 11% (55/464) Resolving deltas: 12% (58/464) Resolving deltas: 13% (61/464) Resolving deltas: 15% (70/464) Resolving deltas: 16% (76/464) Resolving deltas: 18% (87/464) Resolving deltas: 21% (99/464) Resolving deltas: 23% (107/464) Resolving deltas: 24% (114/464) Resolving deltas: 25% (116/464) Resolving deltas: 26% (122/464) Resolving deltas: 27% (128/464) Resolving deltas: 28% (130/464) Resolving deltas: 29% (138/464) Resolving deltas: 30% (140/464) Resolving deltas: 31% (147/464) Resolving deltas: 32% (149/464) Resolving deltas: 33% (154/464) Resolving deltas: 34% (159/464) Resolving deltas: 35% (163/464) Resolving deltas: 36% (168/464) Resolving deltas: 37% (176/464) Resolving deltas: 39% (181/464) Resolving deltas: 40% (190/464) Resolving deltas: 42% (198/464) Resolving deltas: 43% (203/464) Resolving deltas: 44% (206/464) Resolving deltas: 45% (209/464) Resolving deltas: 46% (214/464) Resolving deltas: 47% (220/464) Resolving deltas: 48% (223/464) Resolving deltas: 49% (229/464) Resolving deltas: 50% (232/464) Resolving deltas: 51% (237/464) Resolving deltas: 52% (242/464) Resolving deltas: 53% (246/464) Resolving deltas: 54% (254/464) Resolving deltas: 55% (256/464) Resolving deltas: 56% (263/464) Resolving deltas: 57% (265/464) Resolving deltas: 58% (271/464) Resolving deltas: 59% (274/464) Resolving deltas: 60% (279/464) Resolving deltas: 61% (284/464) Resolving deltas: 62% (288/464) Resolving deltas: 63% (293/464) Resolving deltas: 64% (299/464) Resolving deltas: 65% (302/464) Resolving deltas: 66% (307/464) Resolving deltas: 68% (317/464) Resolving deltas: 69% (323/464) Resolving deltas: 70% (325/464) Resolving deltas: 71% (332/464) Resolving deltas: 72% (336/464) Resolving deltas: 73% (339/464) Resolving deltas: 74% (344/464) Resolving deltas: 75% (348/464) Resolving deltas: 76% (353/464) Resolving deltas: 77% (358/464) Resolving deltas: 78% (362/464) Resolving deltas: 79% (368/464) Resolving deltas: 80% (372/464) Resolving deltas: 81% (376/464) Resolving deltas: 82% (381/464) Resolving deltas: 83% (386/464) Resolving deltas: 84% (391/464) Resolving deltas: 85% (395/464) Resolving deltas: 86% (400/464) Resolving deltas: 87% (404/464) Resolving deltas: 88% (409/464) Resolving deltas: 89% (413/464) Resolving deltas: 90% (418/464) Resolving deltas: 91% (423/464) Resolving deltas: 92% (427/464) Resolving deltas: 93% (432/464) Resolving deltas: 94% (437/464) Resolving deltas: 95% (441/464) Resolving deltas: 96% (446/464) Resolving deltas: 97% (452/464) Resolving deltas: 98% (455/464) Resolving deltas: 99% (460/464) Resolving deltas: 100% (464/464) Resolving deltas: 100% (464/464), completed with 231 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2073/head: No such file or directory
! 1e02ab5...67750ce refs/pull/2073/head -> origin/pr/2073/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2073/merge: No such file or directory
! 3c38bfb...cd1e87a refs/pull/2073/merge -> origin/pr/2073/merge (unable to update local ref)
* [new ref] refs/pull/2283/head -> origin/pr/2283/head
* [new ref] refs/pull/2283/merge -> origin/pr/2283/merge
* [new ref] refs/pull/2284/head -> origin/pr/2284/head
* [new ref] refs/pull/2284/merge -> origin/pr/2284/merge
* [new ref] refs/pull/2285/head -> origin/pr/2285/head
* [new ref] refs/pull/2285/merge -> origin/pr/2285/merge
* [new ref] refs/pull/2286/head -> origin/pr/2286/head
* [new ref] refs/pull/2286/merge -> origin/pr/2286/merge
* [new ref] refs/pull/2287/head -> origin/pr/2287/head
* [new ref] refs/pull/2287/merge -> origin/pr/2287/merge
* [new ref] refs/pull/2288/head -> origin/pr/2288/head
* [new ref] refs/pull/2288/merge -> origin/pr/2288/merge
* [new ref] refs/pull/2289/head -> origin/pr/2289/head
* [new ref] refs/pull/2289/merge -> origin/pr/2289/merge
* [new ref] refs/pull/2290/head -> origin/pr/2290/head
* [new ref] refs/pull/2290/merge -> origin/pr/2290/merge
* [new ref] refs/pull/2291/head -> origin/pr/2291/head
* [new ref] refs/pull/2291/merge -> origin/pr/2291/merge
* [new ref] refs/pull/2292/head -> origin/pr/2292/head
* [new ref] refs/pull/2292/merge -> origin/pr/2292/merge
* [new ref] refs/pull/2293/head -> origin/pr/2293/head
* [new ref] refs/pull/2293/merge -> origin/pr/2293/merge
* [new ref] refs/pull/2294/head -> origin/pr/2294/head
* [new ref] refs/pull/2294/merge -> origin/pr/2294/merge
* [new ref] refs/pull/2295/head -> origin/pr/2295/head
* [new ref] refs/pull/2295/merge -> origin/pr/2295/merge
* [new ref] refs/pull/2296/head -> origin/pr/2296/head
* [new ref] refs/pull/2296/merge -> origin/pr/2296/merge
* [new ref] refs/pull/2297/head -> origin/pr/2297/head
* [new ref] refs/pull/2297/merge -> origin/pr/2297/merge
* [new ref] refs/pull/2298/head -> origin/pr/2298/head
* [new ref] refs/pull/2298/merge -> origin/pr/2298/merge
* [new ref] refs/pull/2299/head -> origin/pr/2299/head
* [new ref] refs/pull/2300/head -> origin/pr/2300/head
* [new ref] refs/pull/2300/merge -> origin/pr/2300/merge
* [new ref] refs/pull/2301/head -> origin/pr/2301/head
* [new ref] refs/pull/2301/merge -> origin/pr/2301/merge
* [new ref] refs/pull/2302/head -> origin/pr/2302/head
* [new ref] refs/pull/2303/head -> origin/pr/2303/head
* [new ref] refs/pull/2303/merge -> origin/pr/2303/merge
* [new ref] refs/pull/2304/head -> origin/pr/2304/head
* [new ref] refs/pull/2304/merge -> origin/pr/2304/merge
* [new ref] refs/pull/2305/head -> origin/pr/2305/head
* [new ref] refs/pull/2305/merge -> origin/pr/2305/merge
* [new ref] refs/pull/2306/head -> origin/pr/2306/head
* [new ref] refs/pull/2306/merge -> origin/pr/2306/merge
* [new ref] refs/pull/2307/head -> origin/pr/2307/head
* [new ref] refs/pull/2307/merge -> origin/pr/2307/merge
* [new ref] refs/pull/2308/head -> origin/pr/2308/head
* [new ref] refs/pull/2308/merge -> origin/pr/2308/merge
* [new ref] refs/pull/2309/head -> origin/pr/2309/head
* [new ref] refs/pull/2309/merge -> origin/pr/2309/merge
* [new ref] refs/pull/2310/head -> origin/pr/2310/head
* [new ref] refs/pull/2310/merge -> origin/pr/2310/merge
* [new ref] refs/pull/2311/head -> origin/pr/2311/head
* [new ref] refs/pull/2311/merge -> origin/pr/2311/merge
* [new ref] refs/pull/2312/head -> origin/pr/2312/head
* [new ref] refs/pull/2312/merge -> origin/pr/2312/merge
* [new ref] refs/pull/2313/head -> origin/pr/2313/head
* [new ref] refs/pull/2313/merge -> origin/pr/2313/merge
* [new ref] refs/pull/2314/head -> origin/pr/2314/head
* [new ref] refs/pull/2314/merge -> origin/pr/2314/merge
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
* [new ref] refs/pull/2330/head -> origin/pr/2330/head
* [new ref] refs/pull/2330/merge -> origin/pr/2330/merge
* [new ref] refs/pull/2402/head -> origin/pr/2402/head
* [new ref] refs/pull/2402/merge -> origin/pr/2402/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb
> git rev-list ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8163220508838366629.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson286956381809416102.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2604565112060869127.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5399521268873777734.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-02 06:02:49,883 217c442d MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/217c442d/pkb.log
2017-04-02 06:02:49,884 217c442d MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-02 06:02:49,886 217c442d MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-02 06:02:50,159 217c442d MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-02 06:02:50,304 217c442d MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-02 06:02:50,308 217c442d MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-02 06:02:50,309 217c442d MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-02 06:02:50,315 217c442d MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-02 06:02:50,318 217c442d MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-02 06:02:50,367 217c442d MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-02 06:02:50,367 217c442d MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/217c442d/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #258
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/258/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb
> git rev-list ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3763396364928959556.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1022013905470363437.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9191405340086227596.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1643192461275503455.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-02 00:00:19,385 aa4f9d99 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/aa4f9d99/pkb.log
2017-04-02 00:00:19,385 aa4f9d99 MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-02 00:00:19,386 aa4f9d99 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-02 00:00:19,532 aa4f9d99 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-02 00:00:19,618 aa4f9d99 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-02 00:00:19,621 aa4f9d99 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-02 00:00:19,621 aa4f9d99 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-02 00:00:19,627 aa4f9d99 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-02 00:00:19,630 aa4f9d99 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-02 00:00:19,652 aa4f9d99 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-02 00:00:19,652 aa4f9d99 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/aa4f9d99/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #257
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/257/display/redirect>
------------------------------------------
[...truncated 270.29 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb
> git rev-list ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3503962770651351220.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7770137278979248982.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5403038263264970690.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4656552769948669707.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-01 18:02:46,961 ddbbb84f MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/ddbbb84f/pkb.log
2017-04-01 18:02:46,961 ddbbb84f MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-01 18:02:46,962 ddbbb84f MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-01 18:02:47,286 ddbbb84f MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-01 18:02:47,423 ddbbb84f MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-01 18:02:47,427 ddbbb84f MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-01 18:02:47,428 ddbbb84f MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-01 18:02:47,438 ddbbb84f MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-01 18:02:47,441 ddbbb84f MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-01 18:02:47,477 ddbbb84f MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-01 18:02:47,478 ddbbb84f MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/ddbbb84f/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #256
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/256/display/redirect?page=changes>
Changes:
[aviemzur] [BEAM-1337] Infer state coders
[kirpichov] [BEAM-1855] Support Splittable DoFn on Flink Runner
------------------------------------------
[...truncated 271.44 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ea33e3373a88a3ea286ea3f49f7a2b3c12aefaeb
> git rev-list 03dce6dccef50210dd420cb9f79baf063bc0b0e8 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7858378557515665033.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9139570584953547818.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6194888861405203360.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4757207268291436745.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-01 12:02:53,430 81396fa5 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/81396fa5/pkb.log
2017-04-01 12:02:53,430 81396fa5 MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-01 12:02:53,431 81396fa5 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-01 12:02:54,233 81396fa5 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-01 12:02:54,429 81396fa5 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-01 12:02:54,433 81396fa5 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-01 12:02:54,433 81396fa5 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-01 12:02:54,441 81396fa5 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-01 12:02:54,444 81396fa5 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-01 12:02:54,500 81396fa5 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-01 12:02:54,501 81396fa5 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/81396fa5/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #255
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/255/display/redirect?page=changes>
Changes:
[kirpichov] KafkaIO : Add withTopic() api that takes single topic.
[tgroh] Separate View Evaluation and Overrides
[robertwb] Only encode PCollection outputs in Runner API protos.
[robertwb] Ensure transforms are picklable before materializing to protos.
[robertwb] Fix side inputs on dataflow runner.
------------------------------------------
[...truncated 271.57 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 03dce6dccef50210dd420cb9f79baf063bc0b0e8 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 03dce6dccef50210dd420cb9f79baf063bc0b0e8
> git rev-list 0b8932fd37c51144cc25313643a0ab098c0d4b21 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7446518103530451054.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6170787510441026415.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8777024282255050673.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2480960010381398048.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-01 06:02:07,008 f16fa6fd MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/f16fa6fd/pkb.log
2017-04-01 06:02:07,008 f16fa6fd MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-01 06:02:07,009 f16fa6fd MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-01 06:02:07,179 f16fa6fd MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-01 06:02:07,269 f16fa6fd MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-01 06:02:07,272 f16fa6fd MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-01 06:02:07,272 f16fa6fd MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-01 06:02:07,277 f16fa6fd MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-01 06:02:07,279 f16fa6fd MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-01 06:02:07,299 f16fa6fd MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-01 06:02:07,300 f16fa6fd MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/f16fa6fd/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #254
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/254/display/redirect?page=changes>
Changes:
[kirpichov] Removes unused name parameter
[kirpichov] Fixes a few warnings in Window
[kirpichov] Uses AutoValue in Window
[kirpichov] Replaced static Window.blah() methods with Window.configure().blah()
[kirpichov] Replaces Window.Bound with simply Window
[robertwb] Change side inputs to be references rather than full PValues.
[altay] use custom hostname for datastore
[tgroh] Use Batch Replacement in the Apex Runner
[kirpichov] Adds requested number of splits to display data in DatastoreIO
------------------------------------------
[...truncated 273.48 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0b8932fd37c51144cc25313643a0ab098c0d4b21 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 0b8932fd37c51144cc25313643a0ab098c0d4b21
> git rev-list 023e6ab94aad0990681eeaa7125d45260cbb1a4c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2746299462437379126.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7202152648261126608.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3708763719982774079.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6248224388270409980.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-04-01 00:02:42,070 63e81d24 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/63e81d24/pkb.log
2017-04-01 00:02:42,070 63e81d24 MainThread INFO PerfKitBenchmarker version: v1.11.0-29-g8c92c13
2017-04-01 00:02:42,071 63e81d24 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-04-01 00:02:42,440 63e81d24 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-04-01 00:02:42,528 63e81d24 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-04-01 00:02:42,530 63e81d24 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-04-01 00:02:42,531 63e81d24 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-04-01 00:02:42,536 63e81d24 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-04-01 00:02:42,538 63e81d24 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-04-01 00:02:42,563 63e81d24 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-04-01 00:02:42,564 63e81d24 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/63e81d24/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #253
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/253/display/redirect?page=changes>
Changes:
[altay] Fixed typos in the Python SDK examples. ( tornatoes -> tornadoes )
[tgroh] Improve PTransformMatcher ToStrings
[tgroh] Include the creating PCollection in PCollectionView
[altay] Add TestStream to Python SDK
------------------------------------------
[...truncated 255.11 KB...]
error: unable to resolve reference refs/remotes/origin/pr/2322/merge: No such file or directory
! 3dc8bbd...c5feb35 refs/pull/2322/merge -> origin/pr/2322/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2323/merge: No such file or directory
! a3e177c...bc8d0de refs/pull/2323/merge -> origin/pr/2323/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2325/merge: No such file or directory
! 2ea8d57...b32e6c1 refs/pull/2325/merge -> origin/pr/2325/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2326/merge: No such file or directory
! b9919b1...a4c411d refs/pull/2326/merge -> origin/pr/2326/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2328/merge: No such file or directory
! 11f18cd...b7ef20d refs/pull/2328/merge -> origin/pr/2328/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2329/merge: No such file or directory
! 4053dbe...b1b38f9 refs/pull/2329/merge -> origin/pr/2329/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2330/merge: No such file or directory
! 320cef4...5d4c028 refs/pull/2330/merge -> origin/pr/2330/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2331/merge: No such file or directory
! 1fe14f4...7a396e9 refs/pull/2331/merge -> origin/pr/2331/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2332/merge: No such file or directory
! 4e92315...0177d82 refs/pull/2332/merge -> origin/pr/2332/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2333/merge: No such file or directory
! be865ca...55589d8 refs/pull/2333/merge -> origin/pr/2333/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2334/merge: No such file or directory
! 8e941b4...eaa378c refs/pull/2334/merge -> origin/pr/2334/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2335/merge: No such file or directory
! ba1e7ef...5db235e refs/pull/2335/merge -> origin/pr/2335/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2336/merge: No such file or directory
! a5c62da...42a0800 refs/pull/2336/merge -> origin/pr/2336/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2339/merge: No such file or directory
! 5f16b77...abfa9d3 refs/pull/2339/merge -> origin/pr/2339/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2340/merge: No such file or directory
! 36acc4d...375e9d0 refs/pull/2340/merge -> origin/pr/2340/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2341/merge: No such file or directory
! f10d47e...1d6959e refs/pull/2341/merge -> origin/pr/2341/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2342/merge: No such file or directory
! 13c1f5a...fcde5dd refs/pull/2342/merge -> origin/pr/2342/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2343/merge: No such file or directory
! 45eef58...8787f6f refs/pull/2343/merge -> origin/pr/2343/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2344/merge: No such file or directory
! bddb67a...7b5f7eb refs/pull/2344/merge -> origin/pr/2344/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2346/merge: No such file or directory
! 1a1c8a8...d41320d refs/pull/2346/merge -> origin/pr/2346/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2347/head: No such file or directory
! 1b97b35...953d6cf refs/pull/2347/head -> origin/pr/2347/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2347/merge: No such file or directory
! f8f773f...7200b15 refs/pull/2347/merge -> origin/pr/2347/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2348/merge: No such file or directory
! 21dca0a...7f5ca62 refs/pull/2348/merge -> origin/pr/2348/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2350/merge: No such file or directory
! 5d61cb3...9cee5f1 refs/pull/2350/merge -> origin/pr/2350/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2351/merge: No such file or directory
! 8a76d16...f167b7e refs/pull/2351/merge -> origin/pr/2351/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2352/merge: No such file or directory
! fcad67f...d23fe85 refs/pull/2352/merge -> origin/pr/2352/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2353/merge: No such file or directory
! 14322f0...c027a3f refs/pull/2353/merge -> origin/pr/2353/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2354/merge: No such file or directory
! 6ca655e...209edc1 refs/pull/2354/merge -> origin/pr/2354/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2355/merge: No such file or directory
! 028898a...b4c6036 refs/pull/2355/merge -> origin/pr/2355/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2356/merge: No such file or directory
! b57600e...ede4418 refs/pull/2356/merge -> origin/pr/2356/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2357/merge: No such file or directory
! ef75baf...dd92bee refs/pull/2357/merge -> origin/pr/2357/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2358/merge: No such file or directory
! 25e4707...662c999 refs/pull/2358/merge -> origin/pr/2358/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2359/merge: No such file or directory
! 8beabda...83f1e89 refs/pull/2359/merge -> origin/pr/2359/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2362/merge: No such file or directory
! 1667c76...d6954f6 refs/pull/2362/merge -> origin/pr/2362/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2363/merge: No such file or directory
! f465ae7...c47fe84 refs/pull/2363/merge -> origin/pr/2363/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2364/head: No such file or directory
! a9b2f0a..330c48d refs/pull/2364/head -> origin/pr/2364/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2364/merge: No such file or directory
! 5d5a0df...ad2ff90 refs/pull/2364/merge -> origin/pr/2364/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2365/merge: No such file or directory
! a4c61a6...67488a6 refs/pull/2365/merge -> origin/pr/2365/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2366/merge: No such file or directory
! a4a1592...e0fc673 refs/pull/2366/merge -> origin/pr/2366/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2367/merge: No such file or directory
! c17f7ee...f6fb10b refs/pull/2367/merge -> origin/pr/2367/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/head: No such file or directory
! f00c850...ff55571 refs/pull/2368/head -> origin/pr/2368/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2368/merge: No such file or directory
! e155e2c...69d5a87 refs/pull/2368/merge -> origin/pr/2368/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2369/head: No such file or directory
! 7ddec2c..56ea7f7 refs/pull/2369/head -> origin/pr/2369/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2369/merge: No such file or directory
! b42b970...0c1cd20 refs/pull/2369/merge -> origin/pr/2369/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2370/head: No such file or directory
! 43e8cbf...3846629 refs/pull/2370/head -> origin/pr/2370/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2370/merge: No such file or directory
! 86f3c5b...f0b8c58 refs/pull/2370/merge -> origin/pr/2370/merge (unable to update local ref)
* [new ref] refs/pull/2371/head -> origin/pr/2371/head
* [new ref] refs/pull/2371/merge -> origin/pr/2371/merge
* [new ref] refs/pull/2372/head -> origin/pr/2372/head
* [new ref] refs/pull/2372/merge -> origin/pr/2372/merge
* [new ref] refs/pull/2373/head -> origin/pr/2373/head
* [new ref] refs/pull/2373/merge -> origin/pr/2373/merge
* [new ref] refs/pull/2374/head -> origin/pr/2374/head
* [new ref] refs/pull/2374/merge -> origin/pr/2374/merge
* [new ref] refs/pull/2375/head -> origin/pr/2375/head
* [new ref] refs/pull/2375/merge -> origin/pr/2375/merge
* [new ref] refs/pull/2376/head -> origin/pr/2376/head
* [new ref] refs/pull/2376/merge -> origin/pr/2376/merge
* [new ref] refs/pull/2377/head -> origin/pr/2377/head
* [new ref] refs/pull/2377/merge -> origin/pr/2377/merge
* [new ref] refs/pull/2378/head -> origin/pr/2378/head
* [new ref] refs/pull/2378/merge -> origin/pr/2378/merge
* [new ref] refs/pull/2379/head -> origin/pr/2379/head
* [new ref] refs/pull/2379/merge -> origin/pr/2379/merge
* [new ref] refs/pull/2380/head -> origin/pr/2380/head
* [new ref] refs/pull/2380/merge -> origin/pr/2380/merge
* [new ref] refs/pull/2381/head -> origin/pr/2381/head
* [new ref] refs/pull/2381/merge -> origin/pr/2381/merge
* [new ref] refs/pull/2382/head -> origin/pr/2382/head
* [new ref] refs/pull/2382/merge -> origin/pr/2382/merge
* [new ref] refs/pull/2383/head -> origin/pr/2383/head
* [new ref] refs/pull/2383/merge -> origin/pr/2383/merge
* [new ref] refs/pull/2384/head -> origin/pr/2384/head
* [new ref] refs/pull/2385/head -> origin/pr/2385/head
* [new ref] refs/pull/2385/merge -> origin/pr/2385/merge
* [new ref] refs/pull/2386/head -> origin/pr/2386/head
* [new ref] refs/pull/2386/merge -> origin/pr/2386/merge
* [new ref] refs/pull/2387/head -> origin/pr/2387/head
* [new ref] refs/pull/2387/merge -> origin/pr/2387/merge
* [new ref] refs/pull/2388/head -> origin/pr/2388/head
* [new ref] refs/pull/2388/merge -> origin/pr/2388/merge
* [new ref] refs/pull/2389/head -> origin/pr/2389/head
* [new ref] refs/pull/2389/merge -> origin/pr/2389/merge
* [new ref] refs/pull/2390/head -> origin/pr/2390/head
* [new ref] refs/pull/2390/merge -> origin/pr/2390/merge
* [new ref] refs/pull/2391/head -> origin/pr/2391/head
* [new ref] refs/pull/2392/head -> origin/pr/2392/head
* [new ref] refs/pull/2392/merge -> origin/pr/2392/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! afdec20...fbb6f89 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam4(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 023e6ab94aad0990681eeaa7125d45260cbb1a4c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 023e6ab94aad0990681eeaa7125d45260cbb1a4c
> git rev-list 68522aa7bffe52770b696bab35746752f677d7b4 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4705132729159120079.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4627057850734183052.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7532032667934708747.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1111744462995566453.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-31 18:03:39,210 df925150 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/df925150/pkb.log
2017-03-31 18:03:39,210 df925150 MainThread INFO PerfKitBenchmarker version: v1.11.0-26-g5630ae4
2017-03-31 18:03:39,211 df925150 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-31 18:03:39,702 df925150 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-31 18:03:39,855 df925150 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-31 18:03:39,858 df925150 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-31 18:03:39,858 df925150 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-31 18:03:39,865 df925150 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-31 18:03:39,868 df925150 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-31 18:03:39,881 df925150 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-31 18:03:39,882 df925150 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/df925150/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #252
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/252/display/redirect?page=changes>
Changes:
[baibaichen] [BEAM-1846] Update os-maven-plugin to 1.5.0.final+ for building shade
------------------------------------------
[...truncated 270.11 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 68522aa7bffe52770b696bab35746752f677d7b4 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 68522aa7bffe52770b696bab35746752f677d7b4
> git rev-list 935ecd4e032e18e428ee33cbf5484c5fce726b4f # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4093925541363724224.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson411834883154081349.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2102098182161247116.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2674564198281892026.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-31 12:02:57,932 61684c32 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/61684c32/pkb.log
2017-03-31 12:02:57,932 61684c32 MainThread INFO PerfKitBenchmarker version: v1.11.0-26-g5630ae4
2017-03-31 12:02:57,933 61684c32 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-31 12:02:58,152 61684c32 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-31 12:02:58,327 61684c32 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-31 12:02:58,331 61684c32 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-31 12:02:58,331 61684c32 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-31 12:02:58,341 61684c32 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-31 12:02:58,344 61684c32 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-31 12:02:58,376 61684c32 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-31 12:02:58,376 61684c32 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/61684c32/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #251
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/251/display/redirect?page=changes>
Changes:
[altay] Increase the memory threshold for the direct runner test
[altay] [BEAM-1441] Fix size check for windows and improve error message
[dhalperi] Reopen BigQuery utils after #2271
[dhalperi] Fixed: small documentation issue in HDFS IO
[dhalperi] Fix PubSubIO write attribute issue
[hepei.hp] [BEAM-1838] GlobalWindow: add equals() and hashCode().
------------------------------------------
[...truncated 275.40 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 935ecd4e032e18e428ee33cbf5484c5fce726b4f (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 935ecd4e032e18e428ee33cbf5484c5fce726b4f
> git rev-list d4de13718ff97d1ab04796ad84cd28b857a2a70f # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6407014905797108834.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5240331839360791084.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7658732838343845604.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2356534014827219015.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-31 06:02:23,369 ff1d68da MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/ff1d68da/pkb.log
2017-03-31 06:02:23,370 ff1d68da MainThread INFO PerfKitBenchmarker version: v1.11.0-26-g5630ae4
2017-03-31 06:02:23,370 ff1d68da MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-31 06:02:23,565 ff1d68da MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-31 06:02:23,664 ff1d68da MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-31 06:02:23,666 ff1d68da MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-31 06:02:23,667 ff1d68da MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-31 06:02:23,673 ff1d68da MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-31 06:02:23,675 ff1d68da MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-31 06:02:23,692 ff1d68da MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-31 06:02:23,693 ff1d68da MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/ff1d68da/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #250
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/250/display/redirect?page=changes>
Changes:
[kirpichov] Fix NPE in Kafka value writer.
[kirpichov] Improves logging in FileBasedSource splitting
[altay] [BEAM-1795] Upgrade google-cloud-bigquery to 0.23.0
------------------------------------------
[...truncated 272.87 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision d4de13718ff97d1ab04796ad84cd28b857a2a70f (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f d4de13718ff97d1ab04796ad84cd28b857a2a70f
> git rev-list ffd87553f3c3c5fc96f1b964d5557cfcd00492f8 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8078336741454935843.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2623492392393985293.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7941525183389821645.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson610577977382156677.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-31 00:02:43,484 58ecfb6b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/58ecfb6b/pkb.log
2017-03-31 00:02:43,484 58ecfb6b MainThread INFO PerfKitBenchmarker version: v1.11.0-25-g559e1bc
2017-03-31 00:02:43,485 58ecfb6b MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-31 00:02:43,737 58ecfb6b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-31 00:02:43,895 58ecfb6b MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-31 00:02:43,899 58ecfb6b MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-31 00:02:43,899 58ecfb6b MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-31 00:02:43,906 58ecfb6b MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-31 00:02:43,908 58ecfb6b MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-31 00:02:43,955 58ecfb6b MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-31 00:02:43,956 58ecfb6b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/58ecfb6b/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #249
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/249/display/redirect?page=changes>
Changes:
[staslevin] Added a specific signature so that Kryo doesn't have to look for it
[robertwb] Translate pipeline graph to and from Runner API protos.
------------------------------------------
[...truncated 269.78 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ffd87553f3c3c5fc96f1b964d5557cfcd00492f8 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ffd87553f3c3c5fc96f1b964d5557cfcd00492f8
> git rev-list 2a40534e80fb84d969ac16bd0d62618109ee04b4 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson539955153583161054.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2106309585025449695.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4496870272099075401.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1036788111483853767.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-30 18:02:38,006 4e472b32 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/4e472b32/pkb.log
2017-03-30 18:02:38,006 4e472b32 MainThread INFO PerfKitBenchmarker version: v1.11.0-24-g5142963
2017-03-30 18:02:38,007 4e472b32 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-30 18:02:38,542 4e472b32 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-30 18:02:38,652 4e472b32 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-30 18:02:38,655 4e472b32 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-30 18:02:38,656 4e472b32 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-30 18:02:38,662 4e472b32 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-30 18:02:38,664 4e472b32 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-30 18:02:38,673 4e472b32 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-30 18:02:38,674 4e472b32 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/4e472b32/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #248
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/248/display/redirect?page=changes>
Changes:
[staslevin] Switched to using "destroy" instead of "unpersist" for broadcasts.
[peihe0] [BEAM-59] Beam FileSystems: add match(), copy(), rename(), delete()
[staslevin] Extracted captures to static classes to prevent them from capturing the
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam4 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2a40534e80fb84d969ac16bd0d62618109ee04b4 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2a40534e80fb84d969ac16bd0d62618109ee04b4
> git rev-list 70aa0a4a43b09aeed0d85609cb479922b3958aff # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson904463458634146462.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2392283623222467746.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8766621157880546334.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Downloading/unpacking python-gflags==3.1.1 (from -r PerfKitBenchmarker/requirements.txt (line 14))
Running setup.py (path:/tmp/pip_build_jenkins/python-gflags/setup.py) egg_info for package python-gflags
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Installing collected packages: python-gflags
Found existing installation: python-gflags 3.0.4
Uninstalling python-gflags:
Successfully uninstalled python-gflags
Running setup.py install for python-gflags
Successfully installed python-gflags
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3910372130762681139.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-30 12:01:01,206 21566daf MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/21566daf/pkb.log
2017-03-30 12:01:01,206 21566daf MainThread INFO PerfKitBenchmarker version: v1.11.0-24-g5142963
2017-03-30 12:01:01,207 21566daf MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-30 12:01:01,590 21566daf MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-30 12:01:01,701 21566daf MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-30 12:01:01,703 21566daf MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-30 12:01:01,704 21566daf MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-30 12:01:01,709 21566daf MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-30 12:01:01,711 21566daf MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-30 12:01:01,734 21566daf MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-30 12:01:01,734 21566daf MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/21566daf/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #247
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/247/display/redirect?page=changes>
Changes:
[altay] Ensure that assert_that takes a PCollection as its first argument.
------------------------------------------
[...truncated 269.48 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 70aa0a4a43b09aeed0d85609cb479922b3958aff (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 70aa0a4a43b09aeed0d85609cb479922b3958aff
> git rev-list 4d633bc5a2679d740efcdf3bbe3350ebcfbbd587 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7223330638024996596.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2978088942825169209.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6029690236785955238.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5684253309217079565.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-30 06:02:12,520 3c74811e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/3c74811e/pkb.log
2017-03-30 06:02:12,521 3c74811e MainThread INFO PerfKitBenchmarker version: v1.11.0-24-g5142963
2017-03-30 06:02:12,521 3c74811e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-30 06:02:12,710 3c74811e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-30 06:02:12,801 3c74811e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-30 06:02:12,804 3c74811e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-30 06:02:12,804 3c74811e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-30 06:02:12,809 3c74811e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-30 06:02:12,812 3c74811e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-30 06:02:12,831 3c74811e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-30 06:02:12,831 3c74811e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/3c74811e/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #246
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/246/display/redirect?page=changes>
Changes:
[tgroh] Update Dataflow Worker Image
[tgroh] Remove View indicator classes
[altay] Add first two mobile gaming examples to Python.
------------------------------------------
[...truncated 267.72 KB...]
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4d633bc5a2679d740efcdf3bbe3350ebcfbbd587 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4d633bc5a2679d740efcdf3bbe3350ebcfbbd587
> git rev-list 8a33591d9bc9dfd328f3b5a3ac22be192d81531a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3925145563129504964.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8545912891343314827.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4331831398007816610.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Downloading/unpacking python-gflags==3.1.1 (from -r PerfKitBenchmarker/requirements.txt (line 14))
Running setup.py (path:/tmp/pip_build_jenkins/python-gflags/setup.py) egg_info for package python-gflags
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Installing collected packages: python-gflags
Found existing installation: python-gflags 3.0.4
Uninstalling python-gflags:
Successfully uninstalled python-gflags
Running setup.py install for python-gflags
Successfully installed python-gflags
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2747579267994278895.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-30 00:02:26,701 eca56caa MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/eca56caa/pkb.log
2017-03-30 00:02:26,702 eca56caa MainThread INFO PerfKitBenchmarker version: v1.11.0-24-g5142963
2017-03-30 00:02:26,702 eca56caa MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-30 00:02:26,908 eca56caa MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-30 00:02:27,009 eca56caa MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-30 00:02:27,011 eca56caa MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-30 00:02:27,012 eca56caa MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-30 00:02:27,018 eca56caa MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-30 00:02:27,021 eca56caa MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-30 00:02:27,041 eca56caa MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-30 00:02:27,041 eca56caa MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/eca56caa/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #245
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/245/display/redirect?page=changes>
Changes:
[amitsela33] [BEAM-1827] Fix use of deprecated Spark APIs in the runner.
------------------------------------------
[...truncated 272.66 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 8a33591d9bc9dfd328f3b5a3ac22be192d81531a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 8a33591d9bc9dfd328f3b5a3ac22be192d81531a
> git rev-list 99056df36efccba26f4853912ffca41e12147949 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3972418661927312914.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4948480707027324093.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8665245671891215910.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8655616202494796490.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-29 18:02:51,743 32f16ce5 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/32f16ce5/pkb.log
2017-03-29 18:02:51,744 32f16ce5 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-29 18:02:51,744 32f16ce5 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-29 18:02:52,033 32f16ce5 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-29 18:02:52,114 32f16ce5 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-29 18:02:52,116 32f16ce5 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-29 18:02:52,117 32f16ce5 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-29 18:02:52,121 32f16ce5 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-29 18:02:52,123 32f16ce5 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-29 18:02:52,154 32f16ce5 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-29 18:02:52,154 32f16ce5 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/32f16ce5/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #244
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/244/display/redirect>
------------------------------------------
[...truncated 267.53 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 99056df36efccba26f4853912ffca41e12147949 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 99056df36efccba26f4853912ffca41e12147949
> git rev-list 99056df36efccba26f4853912ffca41e12147949 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6314034621091716805.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1375950300297427609.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1966787255369482648.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6342284177695016620.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-29 12:02:49,965 bf221f21 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/bf221f21/pkb.log
2017-03-29 12:02:49,965 bf221f21 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-29 12:02:49,965 bf221f21 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-29 12:02:50,193 bf221f21 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-29 12:02:50,275 bf221f21 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-29 12:02:50,277 bf221f21 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-29 12:02:50,277 bf221f21 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-29 12:02:50,282 bf221f21 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-29 12:02:50,284 bf221f21 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-29 12:02:50,313 bf221f21 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-29 12:02:50,314 bf221f21 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/bf221f21/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #243
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/243/display/redirect>
------------------------------------------
[...truncated 265.05 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 99056df36efccba26f4853912ffca41e12147949 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 99056df36efccba26f4853912ffca41e12147949
> git rev-list 99056df36efccba26f4853912ffca41e12147949 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2029099691719842422.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson526237138876406692.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2007842580994264984.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5225230899462335710.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-29 06:02:21,694 1453d783 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/1453d783/pkb.log
2017-03-29 06:02:21,695 1453d783 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-29 06:02:21,696 1453d783 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-29 06:02:22,059 1453d783 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-29 06:02:22,142 1453d783 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-29 06:02:22,144 1453d783 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-29 06:02:22,144 1453d783 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-29 06:02:22,150 1453d783 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-29 06:02:22,152 1453d783 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-29 06:02:22,183 1453d783 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-29 06:02:22,184 1453d783 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/1453d783/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #242
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/242/display/redirect?page=changes>
Changes:
[tgroh] Add PTransform#getAdditionalInputs()
[kirpichov] Removes ParDo.Unbound and UnboundMulti
[kirpichov] Removes accidentally left over class in test
[kirpichov] Renamed ParDo.Bound to ParDo.SingleOutput
[kirpichov] Renamed ParDo.BoundMulti to ParDo.MultiOutput
[tgroh] Update Dataflow Worker
[altay] Replace gsutil with storage API calls
[altay] Fix bugs in fileio in the Temp IOFactory
[kirpichov] Improves logging of FileBasedSource size estimates
------------------------------------------
[...truncated 265.48 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 99056df36efccba26f4853912ffca41e12147949 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 99056df36efccba26f4853912ffca41e12147949
> git rev-list 0582eb9fc31eacdff8b4aa6dfabe570b46fcf7ac # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6920505773730890402.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8986558152314937645.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5447400124719280006.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3035104814227226816.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-29 00:03:23,294 cdd55948 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/cdd55948/pkb.log
2017-03-29 00:03:23,294 cdd55948 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-29 00:03:23,294 cdd55948 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-29 00:03:23,554 cdd55948 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-29 00:03:23,668 cdd55948 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-29 00:03:23,671 cdd55948 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-29 00:03:23,672 cdd55948 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-29 00:03:23,679 cdd55948 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-29 00:03:23,683 cdd55948 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-29 00:03:23,698 cdd55948 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-29 00:03:23,699 cdd55948 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/cdd55948/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #241
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/241/display/redirect?page=changes>
Changes:
[amitsela33] [BEAM-1815] Force a "default" partitioner based on Spark default
[kirpichov] Refactor BigQueryIO helper methods into a BigQueryHelpers class. Move
[kirpichov] Refactor BigQueryIO.Write helper transforms into separate files.
[kirpichov] Move a few more functions into BigQueryHelper
[tgroh] Use CreatePCollectionView explicitly in CombineGloballyAsSingletonView
[klk] Rename RunnableOnService to ValidatesRunner in poms and Jenkins jobs
------------------------------------------
[...truncated 265.67 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0582eb9fc31eacdff8b4aa6dfabe570b46fcf7ac (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 0582eb9fc31eacdff8b4aa6dfabe570b46fcf7ac
> git rev-list d35e1b0d9e47e4eec5c48b5e87ccc9f55955cdf4 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4308609710998719156.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1339915303974984184.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson875739133237664735.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4439121538962172030.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-28 18:03:37,767 7a21af3c MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/7a21af3c/pkb.log
2017-03-28 18:03:37,768 7a21af3c MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-28 18:03:37,768 7a21af3c MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-28 18:03:38,136 7a21af3c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-28 18:03:38,223 7a21af3c MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-28 18:03:38,225 7a21af3c MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-28 18:03:38,226 7a21af3c MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-28 18:03:38,231 7a21af3c MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-28 18:03:38,233 7a21af3c MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-28 18:03:38,263 7a21af3c MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-28 18:03:38,263 7a21af3c MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/7a21af3c/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #240
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/240/display/redirect?page=changes>
Changes:
[ksalant] Fix typo in test pipeline enforcement message
------------------------------------------
[...truncated 264.91 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision d35e1b0d9e47e4eec5c48b5e87ccc9f55955cdf4 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f d35e1b0d9e47e4eec5c48b5e87ccc9f55955cdf4
> git rev-list 48fee91f7d720d03da53476e9a237eabcbfc0460 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4214275089579324141.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4255636973774963536.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2139382828193840855.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3152038469265236769.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-28 12:02:42,582 d3bf7b9e MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d3bf7b9e/pkb.log
2017-03-28 12:02:42,583 d3bf7b9e MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-28 12:02:42,584 d3bf7b9e MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-28 12:02:42,760 d3bf7b9e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-28 12:02:42,897 d3bf7b9e MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-28 12:02:42,899 d3bf7b9e MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-28 12:02:42,900 d3bf7b9e MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-28 12:02:42,906 d3bf7b9e MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-28 12:02:42,908 d3bf7b9e MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-28 12:02:42,933 d3bf7b9e MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-28 12:02:42,934 d3bf7b9e MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d3bf7b9e/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #239
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/239/display/redirect?page=changes>
Changes:
[altay] Querying of both structured and unstructured metrics in dataflow.
[altay] Add region option to Dataflow pipeline options.
[aviemzur] [BEAM-1792] Use MetricFiltering in Spark runner.
[aviemzur] [BEAM-1397] Introduce IO metrics
------------------------------------------
[...truncated 269.04 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 48fee91f7d720d03da53476e9a237eabcbfc0460 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 48fee91f7d720d03da53476e9a237eabcbfc0460
> git rev-list 6d627534b498a418c191ad43c135d3e115c4b5a2 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2003096057819519839.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3561435534812659045.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3840345412239793111.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7675001161594094291.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-28 06:02:20,109 d491e5d5 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/d491e5d5/pkb.log
2017-03-28 06:02:20,109 d491e5d5 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-28 06:02:20,109 d491e5d5 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-28 06:02:20,255 d491e5d5 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-28 06:02:20,334 d491e5d5 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-28 06:02:20,336 d491e5d5 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-28 06:02:20,336 d491e5d5 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-28 06:02:20,341 d491e5d5 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-28 06:02:20,343 d491e5d5 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-28 06:02:20,374 d491e5d5 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-28 06:02:20,374 d491e5d5 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/d491e5d5/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #238
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/238/display/redirect?page=changes>
Changes:
[klk] Port Java modules from RunnableOnService to ValidatesRunner
[klk] Remove deprecated RunnableOnService
[altay] Pin the python postcommit jenkins nodes
[tgroh] Do not reify timestamps in Reshuffle in Dataflow
[tgroh] Make WindowMappingFn#maximumLookback Configurable but Final
[klk] [BEAM-1778] Second clean up pass of dataflow references/URLs in Java SDK
[tgroh] Update Dataflow Worker Image
[altay] Fix Python Dataflow default job name
[altay] [BEAM-1693] Detect supported Python & pip executables in Python-SDK
[davor] [BEAM-1778] Clean up unused dataflow javadoc directory
------------------------------------------
[...truncated 272.09 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6d627534b498a418c191ad43c135d3e115c4b5a2 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6d627534b498a418c191ad43c135d3e115c4b5a2
> git rev-list 61fad2a668536e957fff5fdf250f327932de7d7a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4352215304681977431.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4606891310556192820.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4823999653044465281.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3755113758437448727.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-28 00:02:39,880 dba3d7be MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/dba3d7be/pkb.log
2017-03-28 00:02:39,881 dba3d7be MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-28 00:02:39,882 dba3d7be MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-28 00:02:40,269 dba3d7be MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-28 00:02:40,352 dba3d7be MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-28 00:02:40,354 dba3d7be MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-28 00:02:40,355 dba3d7be MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-28 00:02:40,360 dba3d7be MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-28 00:02:40,362 dba3d7be MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-28 00:02:40,391 dba3d7be MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-28 00:02:40,391 dba3d7be MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/dba3d7be/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #237
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/237/display/redirect?page=changes>
Changes:
[aviemzur] [BEAM-1617] Add Gauge metric type to Java SDK
[dhalperi] [BEAM-1808] Fix typo isPastEndOfWindow => pastEndOfWindow
[dhalperi] Fix checkArgument error message args
[tgroh] Stop emailing individual committers in Performance tests
------------------------------------------
[...truncated 268.22 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 61fad2a668536e957fff5fdf250f327932de7d7a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 61fad2a668536e957fff5fdf250f327932de7d7a
> git rev-list 026aec856c13a7e1e3da08646b9b97ccf1f40e3c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3195057551563896226.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7641046269694586615.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7767855267764902624.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5432187012320554801.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-27 18:02:27,886 6bdf2658 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/6bdf2658/pkb.log
2017-03-27 18:02:27,886 6bdf2658 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-27 18:02:27,887 6bdf2658 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-27 18:02:28,280 6bdf2658 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-27 18:02:28,385 6bdf2658 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-27 18:02:28,389 6bdf2658 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-27 18:02:28,389 6bdf2658 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-27 18:02:28,397 6bdf2658 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-27 18:02:28,400 6bdf2658 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-27 18:02:28,406 6bdf2658 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-27 18:02:28,407 6bdf2658 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/6bdf2658/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #236
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/236/display/redirect>
------------------------------------------
[...truncated 263.18 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 026aec856c13a7e1e3da08646b9b97ccf1f40e3c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 026aec856c13a7e1e3da08646b9b97ccf1f40e3c
> git rev-list 026aec856c13a7e1e3da08646b9b97ccf1f40e3c # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1479500959062501506.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4051828961190227017.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4967807986353721716.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8916230627893774277.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-27 12:03:28,093 ea793f03 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/ea793f03/pkb.log
2017-03-27 12:03:28,097 ea793f03 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-27 12:03:28,097 ea793f03 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-27 12:03:28,230 ea793f03 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-27 12:03:28,313 ea793f03 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-27 12:03:28,316 ea793f03 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-27 12:03:28,316 ea793f03 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-27 12:03:28,322 ea793f03 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-27 12:03:28,324 ea793f03 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-27 12:03:28,346 ea793f03 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-27 12:03:28,347 ea793f03 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/ea793f03/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #235
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/235/display/redirect?page=changes>
Changes:
[iemejia] Fix Regex#AllMatches javadoc
[iemejia] Fix Regex#FindAll javadoc
------------------------------------------
[...truncated 268.47 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 026aec856c13a7e1e3da08646b9b97ccf1f40e3c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 026aec856c13a7e1e3da08646b9b97ccf1f40e3c
> git rev-list c9e55a4360a9fe06d6ed943a222bce524a6b10af # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2393302486849641515.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8625683662058264500.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7312468360097954273.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1093432134765121408.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-27 06:02:27,486 fc5c8ae5 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/fc5c8ae5/pkb.log
2017-03-27 06:02:27,487 fc5c8ae5 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-27 06:02:27,487 fc5c8ae5 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-27 06:02:27,674 fc5c8ae5 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-27 06:02:27,753 fc5c8ae5 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-27 06:02:27,755 fc5c8ae5 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-27 06:02:27,756 fc5c8ae5 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-27 06:02:27,762 fc5c8ae5 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-27 06:02:27,764 fc5c8ae5 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-27 06:02:27,789 fc5c8ae5 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-27 06:02:27,789 fc5c8ae5 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/fc5c8ae5/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #234
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/234/display/redirect>
------------------------------------------
[...truncated 263.43 KB...]
* [new ref] refs/pull/928/head -> origin/pr/928/head
* [new ref] refs/pull/929/head -> origin/pr/929/head
* [new ref] refs/pull/93/head -> origin/pr/93/head
* [new ref] refs/pull/930/head -> origin/pr/930/head
* [new ref] refs/pull/930/merge -> origin/pr/930/merge
* [new ref] refs/pull/931/head -> origin/pr/931/head
* [new ref] refs/pull/931/merge -> origin/pr/931/merge
* [new ref] refs/pull/932/head -> origin/pr/932/head
* [new ref] refs/pull/932/merge -> origin/pr/932/merge
* [new ref] refs/pull/933/head -> origin/pr/933/head
* [new ref] refs/pull/933/merge -> origin/pr/933/merge
* [new ref] refs/pull/934/head -> origin/pr/934/head
* [new ref] refs/pull/934/merge -> origin/pr/934/merge
* [new ref] refs/pull/935/head -> origin/pr/935/head
* [new ref] refs/pull/936/head -> origin/pr/936/head
* [new ref] refs/pull/936/merge -> origin/pr/936/merge
* [new ref] refs/pull/937/head -> origin/pr/937/head
* [new ref] refs/pull/937/merge -> origin/pr/937/merge
* [new ref] refs/pull/938/head -> origin/pr/938/head
* [new ref] refs/pull/939/head -> origin/pr/939/head
* [new ref] refs/pull/94/head -> origin/pr/94/head
* [new ref] refs/pull/940/head -> origin/pr/940/head
* [new ref] refs/pull/940/merge -> origin/pr/940/merge
* [new ref] refs/pull/941/head -> origin/pr/941/head
* [new ref] refs/pull/941/merge -> origin/pr/941/merge
* [new ref] refs/pull/942/head -> origin/pr/942/head
* [new ref] refs/pull/942/merge -> origin/pr/942/merge
* [new ref] refs/pull/943/head -> origin/pr/943/head
* [new ref] refs/pull/943/merge -> origin/pr/943/merge
* [new ref] refs/pull/944/head -> origin/pr/944/head
* [new ref] refs/pull/945/head -> origin/pr/945/head
* [new ref] refs/pull/945/merge -> origin/pr/945/merge
* [new ref] refs/pull/946/head -> origin/pr/946/head
* [new ref] refs/pull/946/merge -> origin/pr/946/merge
* [new ref] refs/pull/947/head -> origin/pr/947/head
* [new ref] refs/pull/947/merge -> origin/pr/947/merge
* [new ref] refs/pull/948/head -> origin/pr/948/head
* [new ref] refs/pull/948/merge -> origin/pr/948/merge
* [new ref] refs/pull/949/head -> origin/pr/949/head
* [new ref] refs/pull/949/merge -> origin/pr/949/merge
* [new ref] refs/pull/95/head -> origin/pr/95/head
* [new ref] refs/pull/95/merge -> origin/pr/95/merge
* [new ref] refs/pull/950/head -> origin/pr/950/head
* [new ref] refs/pull/951/head -> origin/pr/951/head
* [new ref] refs/pull/951/merge -> origin/pr/951/merge
* [new ref] refs/pull/952/head -> origin/pr/952/head
* [new ref] refs/pull/952/merge -> origin/pr/952/merge
* [new ref] refs/pull/953/head -> origin/pr/953/head
* [new ref] refs/pull/954/head -> origin/pr/954/head
* [new ref] refs/pull/954/merge -> origin/pr/954/merge
* [new ref] refs/pull/955/head -> origin/pr/955/head
* [new ref] refs/pull/955/merge -> origin/pr/955/merge
* [new ref] refs/pull/956/head -> origin/pr/956/head
* [new ref] refs/pull/957/head -> origin/pr/957/head
* [new ref] refs/pull/958/head -> origin/pr/958/head
* [new ref] refs/pull/959/head -> origin/pr/959/head
* [new ref] refs/pull/959/merge -> origin/pr/959/merge
* [new ref] refs/pull/96/head -> origin/pr/96/head
* [new ref] refs/pull/96/merge -> origin/pr/96/merge
* [new ref] refs/pull/960/head -> origin/pr/960/head
* [new ref] refs/pull/960/merge -> origin/pr/960/merge
* [new ref] refs/pull/961/head -> origin/pr/961/head
* [new ref] refs/pull/962/head -> origin/pr/962/head
* [new ref] refs/pull/962/merge -> origin/pr/962/merge
* [new ref] refs/pull/963/head -> origin/pr/963/head
* [new ref] refs/pull/963/merge -> origin/pr/963/merge
* [new ref] refs/pull/964/head -> origin/pr/964/head
* [new ref] refs/pull/965/head -> origin/pr/965/head
* [new ref] refs/pull/965/merge -> origin/pr/965/merge
* [new ref] refs/pull/966/head -> origin/pr/966/head
* [new ref] refs/pull/967/head -> origin/pr/967/head
* [new ref] refs/pull/967/merge -> origin/pr/967/merge
* [new ref] refs/pull/968/head -> origin/pr/968/head
* [new ref] refs/pull/968/merge -> origin/pr/968/merge
* [new ref] refs/pull/969/head -> origin/pr/969/head
* [new ref] refs/pull/969/merge -> origin/pr/969/merge
* [new ref] refs/pull/97/head -> origin/pr/97/head
* [new ref] refs/pull/97/merge -> origin/pr/97/merge
* [new ref] refs/pull/970/head -> origin/pr/970/head
* [new ref] refs/pull/970/merge -> origin/pr/970/merge
* [new ref] refs/pull/971/head -> origin/pr/971/head
* [new ref] refs/pull/971/merge -> origin/pr/971/merge
* [new ref] refs/pull/972/head -> origin/pr/972/head
* [new ref] refs/pull/973/head -> origin/pr/973/head
* [new ref] refs/pull/974/head -> origin/pr/974/head
* [new ref] refs/pull/974/merge -> origin/pr/974/merge
* [new ref] refs/pull/975/head -> origin/pr/975/head
* [new ref] refs/pull/975/merge -> origin/pr/975/merge
* [new ref] refs/pull/976/head -> origin/pr/976/head
* [new ref] refs/pull/976/merge -> origin/pr/976/merge
* [new ref] refs/pull/977/head -> origin/pr/977/head
* [new ref] refs/pull/977/merge -> origin/pr/977/merge
* [new ref] refs/pull/978/head -> origin/pr/978/head
* [new ref] refs/pull/978/merge -> origin/pr/978/merge
* [new ref] refs/pull/979/head -> origin/pr/979/head
* [new ref] refs/pull/979/merge -> origin/pr/979/merge
* [new ref] refs/pull/98/head -> origin/pr/98/head
* [new ref] refs/pull/980/head -> origin/pr/980/head
* [new ref] refs/pull/980/merge -> origin/pr/980/merge
* [new ref] refs/pull/981/head -> origin/pr/981/head
* [new ref] refs/pull/982/head -> origin/pr/982/head
* [new ref] refs/pull/982/merge -> origin/pr/982/merge
* [new ref] refs/pull/983/head -> origin/pr/983/head
* [new ref] refs/pull/983/merge -> origin/pr/983/merge
* [new ref] refs/pull/984/head -> origin/pr/984/head
* [new ref] refs/pull/984/merge -> origin/pr/984/merge
* [new ref] refs/pull/985/head -> origin/pr/985/head
* [new ref] refs/pull/985/merge -> origin/pr/985/merge
* [new ref] refs/pull/986/head -> origin/pr/986/head
* [new ref] refs/pull/986/merge -> origin/pr/986/merge
* [new ref] refs/pull/987/head -> origin/pr/987/head
* [new ref] refs/pull/988/head -> origin/pr/988/head
* [new ref] refs/pull/988/merge -> origin/pr/988/merge
* [new ref] refs/pull/989/head -> origin/pr/989/head
* [new ref] refs/pull/989/merge -> origin/pr/989/merge
* [new ref] refs/pull/99/head -> origin/pr/99/head
* [new ref] refs/pull/99/merge -> origin/pr/99/merge
* [new ref] refs/pull/990/head -> origin/pr/990/head
* [new ref] refs/pull/990/merge -> origin/pr/990/merge
* [new ref] refs/pull/991/head -> origin/pr/991/head
* [new ref] refs/pull/991/merge -> origin/pr/991/merge
* [new ref] refs/pull/992/head -> origin/pr/992/head
* [new ref] refs/pull/992/merge -> origin/pr/992/merge
* [new ref] refs/pull/993/head -> origin/pr/993/head
* [new ref] refs/pull/993/merge -> origin/pr/993/merge
* [new ref] refs/pull/994/head -> origin/pr/994/head
* [new ref] refs/pull/994/merge -> origin/pr/994/merge
* [new ref] refs/pull/995/head -> origin/pr/995/head
* [new ref] refs/pull/995/merge -> origin/pr/995/merge
* [new ref] refs/pull/996/head -> origin/pr/996/head
* [new ref] refs/pull/996/merge -> origin/pr/996/merge
* [new ref] refs/pull/997/head -> origin/pr/997/head
* [new ref] refs/pull/997/merge -> origin/pr/997/merge
* [new ref] refs/pull/998/head -> origin/pr/998/head
* [new ref] refs/pull/999/head -> origin/pr/999/head
* [new ref] refs/pull/999/merge -> origin/pr/999/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c9e55a4360a9fe06d6ed943a222bce524a6b10af (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c9e55a4360a9fe06d6ed943a222bce524a6b10af
> git rev-list c9e55a4360a9fe06d6ed943a222bce524a6b10af # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson1439515091840763306.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson7781587697353948952.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5610874942440015800.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson563862718557983456.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-27 00:02:35,796 90cd0ab7 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/90cd0ab7/pkb.log
2017-03-27 00:02:35,796 90cd0ab7 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-27 00:02:35,797 90cd0ab7 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-27 00:02:35,982 90cd0ab7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-27 00:02:36,066 90cd0ab7 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-27 00:02:36,068 90cd0ab7 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-27 00:02:36,068 90cd0ab7 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-27 00:02:36,074 90cd0ab7 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-27 00:02:36,076 90cd0ab7 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-27 00:02:36,107 90cd0ab7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-27 00:02:36,108 90cd0ab7 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/90cd0ab7/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #233
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/233/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam5 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c9e55a4360a9fe06d6ed943a222bce524a6b10af (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c9e55a4360a9fe06d6ed943a222bce524a6b10af
> git rev-list c9e55a4360a9fe06d6ed943a222bce524a6b10af # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson900773831144653672.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4934110300191816667.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2300103037968440314.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3916549271958939212.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-26 18:01:58,740 48272949 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/48272949/pkb.log
2017-03-26 18:01:58,740 48272949 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-26 18:01:58,741 48272949 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-26 18:01:58,962 48272949 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-26 18:01:59,047 48272949 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-26 18:01:59,049 48272949 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-26 18:01:59,049 48272949 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-26 18:01:59,055 48272949 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-26 18:01:59,058 48272949 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-26 18:01:59,089 48272949 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-26 18:01:59,090 48272949 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/48272949/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #232
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/232/display/redirect?page=changes>
Changes:
[aviemzur] [BEAM-1810] Replace usage of RDD#isEmpty on non-serialized RDDs
------------------------------------------
[...truncated 231.31 KB...]
! 77fee20...7435b56 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2156/merge: No such file or directory
! 816ea27...0d9235e refs/pull/2156/merge -> origin/pr/2156/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2157/merge: No such file or directory
! fb7adab...3f207b5 refs/pull/2157/merge -> origin/pr/2157/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2162/merge: No such file or directory
! 2ac1b6b...0e0ce79 refs/pull/2162/merge -> origin/pr/2162/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2166/merge: No such file or directory
! c8946a1...766592c refs/pull/2166/merge -> origin/pr/2166/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2175/merge: No such file or directory
! e3c9273...76b35fb refs/pull/2175/merge -> origin/pr/2175/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2193/merge: No such file or directory
! 08b9b5f...72fb5c2 refs/pull/2193/merge -> origin/pr/2193/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2204/merge: No such file or directory
! f21eeb0...b260f77 refs/pull/2204/merge -> origin/pr/2204/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! eae253e...b88c35e refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2209/merge: No such file or directory
! 2681dd3...88634c8 refs/pull/2209/merge -> origin/pr/2209/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2211/merge: No such file or directory
! 35887b1...19bf250 refs/pull/2211/merge -> origin/pr/2211/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2212/merge: No such file or directory
! 77692f9...1b0cc01 refs/pull/2212/merge -> origin/pr/2212/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2214/merge: No such file or directory
! ca71215...17bb487 refs/pull/2214/merge -> origin/pr/2214/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! bb73bd3...9048601 refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2243/merge: No such file or directory
! 9bd7670...475e2d7 refs/pull/2243/merge -> origin/pr/2243/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2245/merge: No such file or directory
! be6e174...3afe794 refs/pull/2245/merge -> origin/pr/2245/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2263/merge: No such file or directory
! fedd6a8...4bad184 refs/pull/2263/merge -> origin/pr/2263/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! 5af7d9a...135fb1f refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2269/merge: No such file or directory
! b082eb8...1e92c1b refs/pull/2269/merge -> origin/pr/2269/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2271/merge: No such file or directory
! 341b2eb...7e2b80d refs/pull/2271/merge -> origin/pr/2271/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! c06d8f6...a28a9a1 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2282/merge: No such file or directory
! b815133...f74db06 refs/pull/2282/merge -> origin/pr/2282/merge (unable to update local ref)
* [new ref] refs/pull/2283/head -> origin/pr/2283/head
* [new ref] refs/pull/2283/merge -> origin/pr/2283/merge
* [new ref] refs/pull/2284/head -> origin/pr/2284/head
* [new ref] refs/pull/2284/merge -> origin/pr/2284/merge
* [new ref] refs/pull/2285/head -> origin/pr/2285/head
* [new ref] refs/pull/2285/merge -> origin/pr/2285/merge
* [new ref] refs/pull/2286/head -> origin/pr/2286/head
* [new ref] refs/pull/2286/merge -> origin/pr/2286/merge
* [new ref] refs/pull/2287/head -> origin/pr/2287/head
* [new ref] refs/pull/2287/merge -> origin/pr/2287/merge
* [new ref] refs/pull/2288/head -> origin/pr/2288/head
* [new ref] refs/pull/2288/merge -> origin/pr/2288/merge
* [new ref] refs/pull/2289/head -> origin/pr/2289/head
* [new ref] refs/pull/2289/merge -> origin/pr/2289/merge
* [new ref] refs/pull/2290/head -> origin/pr/2290/head
* [new ref] refs/pull/2290/merge -> origin/pr/2290/merge
* [new ref] refs/pull/2291/head -> origin/pr/2291/head
* [new ref] refs/pull/2291/merge -> origin/pr/2291/merge
* [new ref] refs/pull/2292/head -> origin/pr/2292/head
* [new ref] refs/pull/2292/merge -> origin/pr/2292/merge
* [new ref] refs/pull/2293/head -> origin/pr/2293/head
* [new ref] refs/pull/2293/merge -> origin/pr/2293/merge
* [new ref] refs/pull/2294/head -> origin/pr/2294/head
* [new ref] refs/pull/2294/merge -> origin/pr/2294/merge
* [new ref] refs/pull/2295/head -> origin/pr/2295/head
* [new ref] refs/pull/2295/merge -> origin/pr/2295/merge
* [new ref] refs/pull/2296/head -> origin/pr/2296/head
* [new ref] refs/pull/2296/merge -> origin/pr/2296/merge
* [new ref] refs/pull/2297/head -> origin/pr/2297/head
* [new ref] refs/pull/2297/merge -> origin/pr/2297/merge
* [new ref] refs/pull/2298/head -> origin/pr/2298/head
* [new ref] refs/pull/2298/merge -> origin/pr/2298/merge
* [new ref] refs/pull/2299/head -> origin/pr/2299/head
* [new ref] refs/pull/2300/head -> origin/pr/2300/head
* [new ref] refs/pull/2300/merge -> origin/pr/2300/merge
* [new ref] refs/pull/2301/head -> origin/pr/2301/head
* [new ref] refs/pull/2301/merge -> origin/pr/2301/merge
* [new ref] refs/pull/2302/head -> origin/pr/2302/head
* [new ref] refs/pull/2302/merge -> origin/pr/2302/merge
* [new ref] refs/pull/2303/head -> origin/pr/2303/head
* [new ref] refs/pull/2303/merge -> origin/pr/2303/merge
* [new ref] refs/pull/2304/head -> origin/pr/2304/head
* [new ref] refs/pull/2304/merge -> origin/pr/2304/merge
* [new ref] refs/pull/2305/head -> origin/pr/2305/head
* [new ref] refs/pull/2305/merge -> origin/pr/2305/merge
* [new ref] refs/pull/2306/head -> origin/pr/2306/head
* [new ref] refs/pull/2306/merge -> origin/pr/2306/merge
* [new ref] refs/pull/2307/head -> origin/pr/2307/head
* [new ref] refs/pull/2307/merge -> origin/pr/2307/merge
* [new ref] refs/pull/2308/head -> origin/pr/2308/head
* [new ref] refs/pull/2308/merge -> origin/pr/2308/merge
* [new ref] refs/pull/2309/head -> origin/pr/2309/head
* [new ref] refs/pull/2309/merge -> origin/pr/2309/merge
* [new ref] refs/pull/2310/head -> origin/pr/2310/head
* [new ref] refs/pull/2310/merge -> origin/pr/2310/merge
* [new ref] refs/pull/2311/head -> origin/pr/2311/head
* [new ref] refs/pull/2311/merge -> origin/pr/2311/merge
* [new ref] refs/pull/2312/head -> origin/pr/2312/head
* [new ref] refs/pull/2312/merge -> origin/pr/2312/merge
* [new ref] refs/pull/2313/head -> origin/pr/2313/head
* [new ref] refs/pull/2313/merge -> origin/pr/2313/merge
* [new ref] refs/pull/2314/head -> origin/pr/2314/head
* [new ref] refs/pull/2314/merge -> origin/pr/2314/merge
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
* [new ref] refs/pull/2329/head -> origin/pr/2329/head
* [new ref] refs/pull/2329/merge -> origin/pr/2329/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! d074973...2311593 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c9e55a4360a9fe06d6ed943a222bce524a6b10af (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c9e55a4360a9fe06d6ed943a222bce524a6b10af
> git rev-list 348d335883b14a9b143b65e4b3c62dc79f62d77e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2416061251090333404.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3217881486519662891.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson6119920926067228371.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4509421223839734753.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-26 12:02:26,813 7af8ca37 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/7af8ca37/pkb.log
2017-03-26 12:02:26,814 7af8ca37 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-26 12:02:26,814 7af8ca37 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-26 12:02:27,005 7af8ca37 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-26 12:02:27,084 7af8ca37 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-26 12:02:27,086 7af8ca37 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-26 12:02:27,087 7af8ca37 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-26 12:02:27,092 7af8ca37 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-26 12:02:27,094 7af8ca37 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-26 12:02:27,123 7af8ca37 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-26 12:02:27,124 7af8ca37 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/7af8ca37/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #231
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/231/display/redirect>
------------------------------------------
[...truncated 214.77 KB...]
x [deleted] (none) -> origin/pr/99/merge
x [deleted] (none) -> origin/pr/990/head
x [deleted] (none) -> origin/pr/990/merge
x [deleted] (none) -> origin/pr/991/head
x [deleted] (none) -> origin/pr/991/merge
x [deleted] (none) -> origin/pr/992/head
x [deleted] (none) -> origin/pr/992/merge
x [deleted] (none) -> origin/pr/993/head
x [deleted] (none) -> origin/pr/993/merge
x [deleted] (none) -> origin/pr/994/head
x [deleted] (none) -> origin/pr/994/merge
x [deleted] (none) -> origin/pr/995/head
x [deleted] (none) -> origin/pr/995/merge
x [deleted] (none) -> origin/pr/996/head
x [deleted] (none) -> origin/pr/996/merge
x [deleted] (none) -> origin/pr/997/head
x [deleted] (none) -> origin/pr/997/merge
x [deleted] (none) -> origin/pr/998/head
x [deleted] (none) -> origin/pr/999/head
x [deleted] (none) -> origin/pr/999/merge
remote: Counting objects: 1349, done.
remote: Compressing objects: 0% (1/139) remote: Compressing objects: 1% (2/139) remote: Compressing objects: 2% (3/139) remote: Compressing objects: 3% (5/139) remote: Compressing objects: 4% (6/139) remote: Compressing objects: 5% (7/139) remote: Compressing objects: 6% (9/139) remote: Compressing objects: 7% (10/139) remote: Compressing objects: 8% (12/139) remote: Compressing objects: 9% (13/139) remote: Compressing objects: 10% (14/139) remote: Compressing objects: 11% (16/139) remote: Compressing objects: 12% (17/139) remote: Compressing objects: 13% (19/139) remote: Compressing objects: 14% (20/139) remote: Compressing objects: 15% (21/139) remote: Compressing objects: 16% (23/139) remote: Compressing objects: 17% (24/139) remote: Compressing objects: 18% (26/139) remote: Compressing objects: 19% (27/139) remote: Compressing objects: 20% (28/139) remote: Compressing objects: 21% (30/139) remote: Compressing objects: 22% (31/139) remote: Compressing objects: 23% (32/139) remote: Compressing objects: 24% (34/139) remote: Compressing objects: 25% (35/139) remote: Compressing objects: 26% (37/139) remote: Compressing objects: 27% (38/139) remote: Compressing objects: 28% (39/139) remote: Compressing objects: 29% (41/139) remote: Compressing objects: 30% (42/139) remote: Compressing objects: 31% (44/139) remote: Compressing objects: 32% (45/139) remote: Compressing objects: 33% (46/139) remote: Compressing objects: 34% (48/139) remote: Compressing objects: 35% (49/139) remote: Compressing objects: 36% (51/139) remote: Compressing objects: 37% (52/139) remote: Compressing objects: 38% (53/139) remote: Compressing objects: 39% (55/139) remote: Compressing objects: 40% (56/139) remote: Compressing objects: 41% (57/139) remote: Compressing objects: 42% (59/139) remote: Compressing objects: 43% (60/139) remote: Compressing objects: 44% (62/139) remote: Compressing objects: 45% (63/139) remote: Compressing objects: 46% (64/139) remote: Compressing objects: 47% (66/139) remote: Compressing objects: 48% (67/139) remote: Compressing objects: 49% (69/139) remote: Compressing objects: 50% (70/139) remote: Compressing objects: 51% (71/139) remote: Compressing objects: 52% (73/139) remote: Compressing objects: 53% (74/139) remote: Compressing objects: 54% (76/139) remote: Compressing objects: 55% (77/139) remote: Compressing objects: 56% (78/139) remote: Compressing objects: 57% (80/139) remote: Compressing objects: 58% (81/139) remote: Compressing objects: 59% (83/139) remote: Compressing objects: 60% (84/139) remote: Compressing objects: 61% (85/139) remote: Compressing objects: 62% (87/139) remote: Compressing objects: 63% (88/139) remote: Compressing objects: 64% (89/139) remote: Compressing objects: 65% (91/139) remote: Compressing objects: 66% (92/139) remote: Compressing objects: 67% (94/139) remote: Compressing objects: 68% (95/139) remote: Compressing objects: 69% (96/139) remote: Compressing objects: 70% (98/139) remote: Compressing objects: 71% (99/139) remote: Compressing objects: 72% (101/139) remote: Compressing objects: 73% (102/139) remote: Compressing objects: 74% (103/139) remote: Compressing objects: 75% (105/139) remote: Compressing objects: 76% (106/139) remote: Compressing objects: 77% (108/139) remote: Compressing objects: 78% (109/139) remote: Compressing objects: 79% (110/139) remote: Compressing objects: 80% (112/139) remote: Compressing objects: 81% (113/139) remote: Compressing objects: 82% (114/139) remote: Compressing objects: 83% (116/139) remote: Compressing objects: 84% (117/139) remote: Compressing objects: 85% (119/139) remote: Compressing objects: 86% (120/139) remote: Compressing objects: 87% (121/139) remote: Compressing objects: 88% (123/139) remote: Compressing objects: 89% (124/139) remote: Compressing objects: 90% (126/139) remote: Compressing objects: 91% (127/139) remote: Compressing objects: 92% (128/139) remote: Compressing objects: 93% (130/139) remote: Compressing objects: 94% (131/139) remote: Compressing objects: 95% (133/139) remote: Compressing objects: 96% (134/139) remote: Compressing objects: 97% (135/139) remote: Compressing objects: 98% (137/139) remote: Compressing objects: 99% (138/139) remote: Compressing objects: 100% (139/139) remote: Compressing objects: 100% (139/139), done.
Receiving objects: 0% (1/1349) Receiving objects: 1% (14/1349) Receiving objects: 2% (27/1349) Receiving objects: 3% (41/1349) Receiving objects: 4% (54/1349) Receiving objects: 5% (68/1349) Receiving objects: 6% (81/1349) Receiving objects: 7% (95/1349) Receiving objects: 8% (108/1349) Receiving objects: 9% (122/1349) Receiving objects: 10% (135/1349) Receiving objects: 11% (149/1349) Receiving objects: 12% (162/1349) Receiving objects: 13% (176/1349) Receiving objects: 14% (189/1349) Receiving objects: 15% (203/1349) Receiving objects: 16% (216/1349) Receiving objects: 17% (230/1349) Receiving objects: 18% (243/1349) Receiving objects: 19% (257/1349) Receiving objects: 20% (270/1349) Receiving objects: 21% (284/1349) Receiving objects: 22% (297/1349) Receiving objects: 23% (311/1349) Receiving objects: 24% (324/1349) Receiving objects: 25% (338/1349) Receiving objects: 26% (351/1349) Receiving objects: 27% (365/1349) Receiving objects: 28% (378/1349) Receiving objects: 29% (392/1349) Receiving objects: 30% (405/1349) Receiving objects: 31% (419/1349) Receiving objects: 32% (432/1349) Receiving objects: 33% (446/1349) Receiving objects: 34% (459/1349) Receiving objects: 35% (473/1349) Receiving objects: 36% (486/1349) Receiving objects: 37% (500/1349) Receiving objects: 38% (513/1349) Receiving objects: 39% (527/1349) Receiving objects: 40% (540/1349) Receiving objects: 41% (554/1349) Receiving objects: 42% (567/1349) Receiving objects: 43% (581/1349) Receiving objects: 44% (594/1349) Receiving objects: 45% (608/1349) Receiving objects: 46% (621/1349) Receiving objects: 47% (635/1349) Receiving objects: 48% (648/1349) Receiving objects: 49% (662/1349) Receiving objects: 50% (675/1349) Receiving objects: 51% (688/1349) Receiving objects: 52% (702/1349) Receiving objects: 53% (715/1349) Receiving objects: 54% (729/1349) Receiving objects: 55% (742/1349) Receiving objects: 56% (756/1349) Receiving objects: 57% (769/1349) Receiving objects: 58% (783/1349) Receiving objects: 59% (796/1349) Receiving objects: 60% (810/1349) Receiving objects: 61% (823/1349) Receiving objects: 62% (837/1349) Receiving objects: 63% (850/1349) Receiving objects: 64% (864/1349) Receiving objects: 65% (877/1349) Receiving objects: 66% (891/1349) Receiving objects: 67% (904/1349) Receiving objects: 68% (918/1349) Receiving objects: 69% (931/1349) Receiving objects: 70% (945/1349) Receiving objects: 71% (958/1349) Receiving objects: 72% (972/1349) Receiving objects: 73% (985/1349) Receiving objects: 74% (999/1349) Receiving objects: 75% (1012/1349) Receiving objects: 76% (1026/1349) Receiving objects: 77% (1039/1349) Receiving objects: 78% (1053/1349) Receiving objects: 79% (1066/1349) Receiving objects: 80% (1080/1349) Receiving objects: 81% (1093/1349) Receiving objects: 82% (1107/1349) Receiving objects: 83% (1120/1349) Receiving objects: 84% (1134/1349) Receiving objects: 85% (1147/1349) Receiving objects: 86% (1161/1349) Receiving objects: 87% (1174/1349) Receiving objects: 88% (1188/1349) Receiving objects: 89% (1201/1349) remote: Total 1349 (delta 567), reused 498 (delta 498), pack-reused 680
Receiving objects: 90% (1215/1349) Receiving objects: 91% (1228/1349) Receiving objects: 92% (1242/1349) Receiving objects: 93% (1255/1349) Receiving objects: 94% (1269/1349) Receiving objects: 95% (1282/1349) Receiving objects: 96% (1296/1349) Receiving objects: 97% (1309/1349) Receiving objects: 98% (1323/1349) Receiving objects: 99% (1336/1349) Receiving objects: 100% (1349/1349) Receiving objects: 100% (1349/1349), 161.73 KiB | 0 bytes/s, done.
Resolving deltas: 0% (0/588) Resolving deltas: 1% (6/588) Resolving deltas: 2% (12/588) Resolving deltas: 3% (18/588) Resolving deltas: 4% (24/588) Resolving deltas: 5% (32/588) Resolving deltas: 6% (36/588) Resolving deltas: 8% (48/588) Resolving deltas: 9% (55/588) Resolving deltas: 10% (60/588) Resolving deltas: 11% (68/588) Resolving deltas: 13% (82/588) Resolving deltas: 14% (84/588) Resolving deltas: 15% (89/588) Resolving deltas: 16% (98/588) Resolving deltas: 17% (100/588) Resolving deltas: 18% (106/588) Resolving deltas: 19% (112/588) Resolving deltas: 20% (118/588) Resolving deltas: 21% (126/588) Resolving deltas: 22% (130/588) Resolving deltas: 24% (142/588) Resolving deltas: 25% (147/588) Resolving deltas: 28% (166/588) Resolving deltas: 29% (174/588) Resolving deltas: 31% (183/588) Resolving deltas: 32% (189/588) Resolving deltas: 33% (195/588) Resolving deltas: 34% (204/588) Resolving deltas: 35% (208/588) Resolving deltas: 36% (212/588) Resolving deltas: 37% (221/588) Resolving deltas: 39% (230/588) Resolving deltas: 40% (236/588) Resolving deltas: 41% (244/588) Resolving deltas: 42% (248/588) Resolving deltas: 43% (254/588) Resolving deltas: 44% (261/588) Resolving deltas: 45% (268/588) Resolving deltas: 46% (272/588) Resolving deltas: 47% (277/588) Resolving deltas: 48% (283/588) Resolving deltas: 49% (289/588) Resolving deltas: 50% (296/588) Resolving deltas: 51% (300/588) Resolving deltas: 52% (309/588) Resolving deltas: 53% (312/588) Resolving deltas: 54% (319/588) Resolving deltas: 55% (325/588) Resolving deltas: 56% (330/588) Resolving deltas: 57% (336/588) Resolving deltas: 58% (342/588) Resolving deltas: 59% (348/588) Resolving deltas: 60% (353/588) Resolving deltas: 61% (359/588) Resolving deltas: 62% (365/588) Resolving deltas: 63% (372/588) Resolving deltas: 64% (377/588) Resolving deltas: 65% (384/588) Resolving deltas: 66% (393/588) Resolving deltas: 67% (394/588) Resolving deltas: 68% (401/588) Resolving deltas: 69% (407/588) Resolving deltas: 70% (413/588) Resolving deltas: 71% (418/588) Resolving deltas: 72% (424/588) Resolving deltas: 73% (430/588) Resolving deltas: 74% (436/588) Resolving deltas: 75% (441/588) Resolving deltas: 76% (447/588) Resolving deltas: 77% (453/588) Resolving deltas: 78% (459/588) Resolving deltas: 79% (465/588) Resolving deltas: 80% (472/588) Resolving deltas: 81% (478/588) Resolving deltas: 82% (486/588) Resolving deltas: 83% (490/588) Resolving deltas: 84% (494/588) Resolving deltas: 85% (500/588) Resolving deltas: 86% (506/588) Resolving deltas: 87% (512/588) Resolving deltas: 88% (518/588) Resolving deltas: 89% (524/588) Resolving deltas: 90% (530/588) Resolving deltas: 91% (537/588) Resolving deltas: 92% (541/588) Resolving deltas: 93% (547/588) Resolving deltas: 94% (553/588) Resolving deltas: 95% (560/588) Resolving deltas: 96% (565/588) Resolving deltas: 97% (571/588) Resolving deltas: 98% (577/588) Resolving deltas: 99% (584/588) Resolving deltas: 100% (588/588) Resolving deltas: 100% (588/588), completed with 263 local objects.
error: unable to resolve reference refs/remotes/origin/pr/2069/merge: No such file or directory
! 377c89c...3c353e5 refs/pull/2069/merge -> origin/pr/2069/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2099/merge: No such file or directory
! 1c94971...3a0fb1c refs/pull/2099/merge -> origin/pr/2099/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2110/merge: No such file or directory
! 7f4bf15...e724f33 refs/pull/2110/merge -> origin/pr/2110/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2116/merge: No such file or directory
! 53b2364...8585a61 refs/pull/2116/merge -> origin/pr/2116/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2118/merge: No such file or directory
! 72a14e2...85180fc refs/pull/2118/merge -> origin/pr/2118/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2167/merge: No such file or directory
! cdfe6fd...ae53bf7 refs/pull/2167/merge -> origin/pr/2167/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2190/merge: No such file or directory
! b4c0a9d...7d34f4b refs/pull/2190/merge -> origin/pr/2190/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2203/merge: No such file or directory
! 6059e20...6e426e6 refs/pull/2203/merge -> origin/pr/2203/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2218/merge: No such file or directory
! 4aa5f55...222b61b refs/pull/2218/merge -> origin/pr/2218/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2239/merge: No such file or directory
! 4d5f8e3...4ee88ed refs/pull/2239/merge -> origin/pr/2239/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2275/merge: No such file or directory
! 85e5b7e...120c071 refs/pull/2275/merge -> origin/pr/2275/merge (unable to update local ref)
* [new ref] refs/pull/2283/head -> origin/pr/2283/head
* [new ref] refs/pull/2283/merge -> origin/pr/2283/merge
* [new ref] refs/pull/2284/head -> origin/pr/2284/head
* [new ref] refs/pull/2284/merge -> origin/pr/2284/merge
* [new ref] refs/pull/2285/head -> origin/pr/2285/head
* [new ref] refs/pull/2285/merge -> origin/pr/2285/merge
* [new ref] refs/pull/2286/head -> origin/pr/2286/head
* [new ref] refs/pull/2286/merge -> origin/pr/2286/merge
* [new ref] refs/pull/2287/head -> origin/pr/2287/head
* [new ref] refs/pull/2287/merge -> origin/pr/2287/merge
* [new ref] refs/pull/2288/head -> origin/pr/2288/head
* [new ref] refs/pull/2288/merge -> origin/pr/2288/merge
* [new ref] refs/pull/2289/head -> origin/pr/2289/head
* [new ref] refs/pull/2289/merge -> origin/pr/2289/merge
* [new ref] refs/pull/2290/head -> origin/pr/2290/head
* [new ref] refs/pull/2290/merge -> origin/pr/2290/merge
* [new ref] refs/pull/2291/head -> origin/pr/2291/head
* [new ref] refs/pull/2291/merge -> origin/pr/2291/merge
* [new ref] refs/pull/2292/head -> origin/pr/2292/head
* [new ref] refs/pull/2292/merge -> origin/pr/2292/merge
* [new ref] refs/pull/2293/head -> origin/pr/2293/head
* [new ref] refs/pull/2293/merge -> origin/pr/2293/merge
* [new ref] refs/pull/2294/head -> origin/pr/2294/head
* [new ref] refs/pull/2294/merge -> origin/pr/2294/merge
* [new ref] refs/pull/2295/head -> origin/pr/2295/head
* [new ref] refs/pull/2295/merge -> origin/pr/2295/merge
* [new ref] refs/pull/2296/head -> origin/pr/2296/head
* [new ref] refs/pull/2296/merge -> origin/pr/2296/merge
* [new ref] refs/pull/2297/head -> origin/pr/2297/head
* [new ref] refs/pull/2297/merge -> origin/pr/2297/merge
* [new ref] refs/pull/2298/head -> origin/pr/2298/head
* [new ref] refs/pull/2298/merge -> origin/pr/2298/merge
* [new ref] refs/pull/2299/head -> origin/pr/2299/head
* [new ref] refs/pull/2300/head -> origin/pr/2300/head
* [new ref] refs/pull/2300/merge -> origin/pr/2300/merge
* [new ref] refs/pull/2301/head -> origin/pr/2301/head
* [new ref] refs/pull/2301/merge -> origin/pr/2301/merge
* [new ref] refs/pull/2302/head -> origin/pr/2302/head
* [new ref] refs/pull/2302/merge -> origin/pr/2302/merge
* [new ref] refs/pull/2303/head -> origin/pr/2303/head
* [new ref] refs/pull/2303/merge -> origin/pr/2303/merge
* [new ref] refs/pull/2304/head -> origin/pr/2304/head
* [new ref] refs/pull/2304/merge -> origin/pr/2304/merge
* [new ref] refs/pull/2305/head -> origin/pr/2305/head
* [new ref] refs/pull/2305/merge -> origin/pr/2305/merge
* [new ref] refs/pull/2306/head -> origin/pr/2306/head
* [new ref] refs/pull/2306/merge -> origin/pr/2306/merge
* [new ref] refs/pull/2307/head -> origin/pr/2307/head
* [new ref] refs/pull/2307/merge -> origin/pr/2307/merge
* [new ref] refs/pull/2308/head -> origin/pr/2308/head
* [new ref] refs/pull/2308/merge -> origin/pr/2308/merge
* [new ref] refs/pull/2309/head -> origin/pr/2309/head
* [new ref] refs/pull/2309/merge -> origin/pr/2309/merge
* [new ref] refs/pull/2310/head -> origin/pr/2310/head
* [new ref] refs/pull/2310/merge -> origin/pr/2310/merge
* [new ref] refs/pull/2311/head -> origin/pr/2311/head
* [new ref] refs/pull/2311/merge -> origin/pr/2311/merge
* [new ref] refs/pull/2312/head -> origin/pr/2312/head
* [new ref] refs/pull/2312/merge -> origin/pr/2312/merge
* [new ref] refs/pull/2313/head -> origin/pr/2313/head
* [new ref] refs/pull/2313/merge -> origin/pr/2313/merge
* [new ref] refs/pull/2314/head -> origin/pr/2314/head
* [new ref] refs/pull/2314/merge -> origin/pr/2314/merge
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 348d335883b14a9b143b65e4b3c62dc79f62d77e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 348d335883b14a9b143b65e4b3c62dc79f62d77e
> git rev-list 348d335883b14a9b143b65e4b3c62dc79f62d77e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8599353461779472874.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5862565581852740309.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson9166284458353158845.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson8791182151703211637.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-26 06:02:30,915 c616e0b5 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/c616e0b5/pkb.log
2017-03-26 06:02:30,915 c616e0b5 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-26 06:02:30,916 c616e0b5 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-26 06:02:31,096 c616e0b5 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-26 06:02:31,209 c616e0b5 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-26 06:02:31,212 c616e0b5 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-26 06:02:31,213 c616e0b5 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-26 06:02:31,220 c616e0b5 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-26 06:02:31,222 c616e0b5 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-26 06:02:31,281 c616e0b5 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-26 06:02:31,281 c616e0b5 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/c616e0b5/pkb.log
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_Dataflow #230
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Dataflow/230/display/redirect?page=changes>
Changes:
[amitsela33] [BEAM-1802] Stop Spark context on terminal pipeline state
------------------------------------------
[...truncated 231.24 KB...]
! dcbfe5e...77fee20 refs/pull/2154/merge -> origin/pr/2154/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2156/merge: No such file or directory
! d3a880e...816ea27 refs/pull/2156/merge -> origin/pr/2156/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2157/merge: No such file or directory
! 785a574...fb7adab refs/pull/2157/merge -> origin/pr/2157/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2162/merge: No such file or directory
! da03af7...2ac1b6b refs/pull/2162/merge -> origin/pr/2162/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2166/head: No such file or directory
! 49beb06..90754bb refs/pull/2166/head -> origin/pr/2166/head (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2166/merge: No such file or directory
! b369119...c8946a1 refs/pull/2166/merge -> origin/pr/2166/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2175/merge: No such file or directory
! e5ae8fe...e3c9273 refs/pull/2175/merge -> origin/pr/2175/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2193/merge: No such file or directory
! 7c64cf0...08b9b5f refs/pull/2193/merge -> origin/pr/2193/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2204/merge: No such file or directory
! 05fb5ca...f21eeb0 refs/pull/2204/merge -> origin/pr/2204/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2207/merge: No such file or directory
! e17a4bc...eae253e refs/pull/2207/merge -> origin/pr/2207/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2209/merge: No such file or directory
! 18de94d...2681dd3 refs/pull/2209/merge -> origin/pr/2209/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2211/merge: No such file or directory
! 02dafbc...35887b1 refs/pull/2211/merge -> origin/pr/2211/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2212/merge: No such file or directory
! 7900ba3...77692f9 refs/pull/2212/merge -> origin/pr/2212/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2214/merge: No such file or directory
! dd313ba...ca71215 refs/pull/2214/merge -> origin/pr/2214/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2216/merge: No such file or directory
! f76efd0...bb73bd3 refs/pull/2216/merge -> origin/pr/2216/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2243/merge: No such file or directory
! e537a21...9bd7670 refs/pull/2243/merge -> origin/pr/2243/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2245/merge: No such file or directory
! edbc166...be6e174 refs/pull/2245/merge -> origin/pr/2245/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2263/merge: No such file or directory
! 5ba4146...fedd6a8 refs/pull/2263/merge -> origin/pr/2263/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2266/merge: No such file or directory
! f391d18...5af7d9a refs/pull/2266/merge -> origin/pr/2266/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2269/merge: No such file or directory
! 0af40ed...b082eb8 refs/pull/2269/merge -> origin/pr/2269/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2271/merge: No such file or directory
! fc11a6a...341b2eb refs/pull/2271/merge -> origin/pr/2271/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2273/merge: No such file or directory
! 7cbdd2b...c06d8f6 refs/pull/2273/merge -> origin/pr/2273/merge (unable to update local ref)
error: unable to resolve reference refs/remotes/origin/pr/2282/merge: No such file or directory
! d8bb1c9...b815133 refs/pull/2282/merge -> origin/pr/2282/merge (unable to update local ref)
* [new ref] refs/pull/2283/head -> origin/pr/2283/head
* [new ref] refs/pull/2283/merge -> origin/pr/2283/merge
* [new ref] refs/pull/2284/head -> origin/pr/2284/head
* [new ref] refs/pull/2284/merge -> origin/pr/2284/merge
* [new ref] refs/pull/2285/head -> origin/pr/2285/head
* [new ref] refs/pull/2285/merge -> origin/pr/2285/merge
* [new ref] refs/pull/2286/head -> origin/pr/2286/head
* [new ref] refs/pull/2286/merge -> origin/pr/2286/merge
* [new ref] refs/pull/2287/head -> origin/pr/2287/head
* [new ref] refs/pull/2287/merge -> origin/pr/2287/merge
* [new ref] refs/pull/2288/head -> origin/pr/2288/head
* [new ref] refs/pull/2288/merge -> origin/pr/2288/merge
* [new ref] refs/pull/2289/head -> origin/pr/2289/head
* [new ref] refs/pull/2289/merge -> origin/pr/2289/merge
* [new ref] refs/pull/2290/head -> origin/pr/2290/head
* [new ref] refs/pull/2290/merge -> origin/pr/2290/merge
* [new ref] refs/pull/2291/head -> origin/pr/2291/head
* [new ref] refs/pull/2291/merge -> origin/pr/2291/merge
* [new ref] refs/pull/2292/head -> origin/pr/2292/head
* [new ref] refs/pull/2292/merge -> origin/pr/2292/merge
* [new ref] refs/pull/2293/head -> origin/pr/2293/head
* [new ref] refs/pull/2293/merge -> origin/pr/2293/merge
* [new ref] refs/pull/2294/head -> origin/pr/2294/head
* [new ref] refs/pull/2294/merge -> origin/pr/2294/merge
* [new ref] refs/pull/2295/head -> origin/pr/2295/head
* [new ref] refs/pull/2295/merge -> origin/pr/2295/merge
* [new ref] refs/pull/2296/head -> origin/pr/2296/head
* [new ref] refs/pull/2296/merge -> origin/pr/2296/merge
* [new ref] refs/pull/2297/head -> origin/pr/2297/head
* [new ref] refs/pull/2297/merge -> origin/pr/2297/merge
* [new ref] refs/pull/2298/head -> origin/pr/2298/head
* [new ref] refs/pull/2298/merge -> origin/pr/2298/merge
* [new ref] refs/pull/2299/head -> origin/pr/2299/head
* [new ref] refs/pull/2300/head -> origin/pr/2300/head
* [new ref] refs/pull/2300/merge -> origin/pr/2300/merge
* [new ref] refs/pull/2301/head -> origin/pr/2301/head
* [new ref] refs/pull/2301/merge -> origin/pr/2301/merge
* [new ref] refs/pull/2302/head -> origin/pr/2302/head
* [new ref] refs/pull/2302/merge -> origin/pr/2302/merge
* [new ref] refs/pull/2303/head -> origin/pr/2303/head
* [new ref] refs/pull/2303/merge -> origin/pr/2303/merge
* [new ref] refs/pull/2304/head -> origin/pr/2304/head
* [new ref] refs/pull/2304/merge -> origin/pr/2304/merge
* [new ref] refs/pull/2305/head -> origin/pr/2305/head
* [new ref] refs/pull/2305/merge -> origin/pr/2305/merge
* [new ref] refs/pull/2306/head -> origin/pr/2306/head
* [new ref] refs/pull/2306/merge -> origin/pr/2306/merge
* [new ref] refs/pull/2307/head -> origin/pr/2307/head
* [new ref] refs/pull/2307/merge -> origin/pr/2307/merge
* [new ref] refs/pull/2308/head -> origin/pr/2308/head
* [new ref] refs/pull/2308/merge -> origin/pr/2308/merge
* [new ref] refs/pull/2309/head -> origin/pr/2309/head
* [new ref] refs/pull/2309/merge -> origin/pr/2309/merge
* [new ref] refs/pull/2310/head -> origin/pr/2310/head
* [new ref] refs/pull/2310/merge -> origin/pr/2310/merge
* [new ref] refs/pull/2311/head -> origin/pr/2311/head
* [new ref] refs/pull/2311/merge -> origin/pr/2311/merge
* [new ref] refs/pull/2312/head -> origin/pr/2312/head
* [new ref] refs/pull/2312/merge -> origin/pr/2312/merge
* [new ref] refs/pull/2313/head -> origin/pr/2313/head
* [new ref] refs/pull/2313/merge -> origin/pr/2313/merge
* [new ref] refs/pull/2314/head -> origin/pr/2314/head
* [new ref] refs/pull/2314/merge -> origin/pr/2314/merge
* [new ref] refs/pull/2315/head -> origin/pr/2315/head
* [new ref] refs/pull/2315/merge -> origin/pr/2315/merge
* [new ref] refs/pull/2316/head -> origin/pr/2316/head
* [new ref] refs/pull/2316/merge -> origin/pr/2316/merge
* [new ref] refs/pull/2317/head -> origin/pr/2317/head
* [new ref] refs/pull/2317/merge -> origin/pr/2317/merge
* [new ref] refs/pull/2318/head -> origin/pr/2318/head
* [new ref] refs/pull/2318/merge -> origin/pr/2318/merge
* [new ref] refs/pull/2319/head -> origin/pr/2319/head
* [new ref] refs/pull/2319/merge -> origin/pr/2319/merge
* [new ref] refs/pull/2320/head -> origin/pr/2320/head
* [new ref] refs/pull/2321/head -> origin/pr/2321/head
* [new ref] refs/pull/2321/merge -> origin/pr/2321/merge
* [new ref] refs/pull/2322/head -> origin/pr/2322/head
* [new ref] refs/pull/2322/merge -> origin/pr/2322/merge
* [new ref] refs/pull/2323/head -> origin/pr/2323/head
* [new ref] refs/pull/2323/merge -> origin/pr/2323/merge
* [new ref] refs/pull/2324/head -> origin/pr/2324/head
* [new ref] refs/pull/2325/head -> origin/pr/2325/head
* [new ref] refs/pull/2325/merge -> origin/pr/2325/merge
* [new ref] refs/pull/2326/head -> origin/pr/2326/head
* [new ref] refs/pull/2326/merge -> origin/pr/2326/merge
* [new ref] refs/pull/2327/head -> origin/pr/2327/head
* [new ref] refs/pull/2327/merge -> origin/pr/2327/merge
* [new ref] refs/pull/2328/head -> origin/pr/2328/head
* [new ref] refs/pull/2328/merge -> origin/pr/2328/merge
error: unable to resolve reference refs/remotes/origin/pr/592/merge: No such file or directory
! ed268ba...d074973 refs/pull/592/merge -> origin/pr/592/merge (unable to update local ref)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ......remote call to beam5(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor699.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy97.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Pruning obsolete local branches
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 348d335883b14a9b143b65e4b3c62dc79f62d77e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 348d335883b14a9b143b65e4b3c62dc79f62d77e
> git rev-list 3473055f2358533dfb18af225ffdee2c8eca4000 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson4060152476216232296.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson5340144087165042966.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson2927534065347390538.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.11 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Dataflow] $ /bin/bash -xe /tmp/hudson3176435364044555351.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --benchmarks=dpb_wordcount_benchmark --dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging --dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt --config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-03-26 00:02:41,577 a66e6831 MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/a66e6831/pkb.log
2017-03-26 00:02:41,577 a66e6831 MainThread INFO PerfKitBenchmarker version: v1.11.0-23-gdc9ac3e
2017-03-26 00:02:41,578 a66e6831 MainThread INFO Flag values:
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--dpb_wordcount_input=dataflow-samples/shakespeare/kinglear.txt
--dpb_log_level=INFO
--official
--benchmarks=dpb_wordcount_benchmark
--config_override=dpb_wordcount_benchmark.dpb_service.service_type=dataflow
--dpb_dataflow_staging_location=gs://temp-storage-for-perf-tests/staging
2017-03-26 00:02:41,809 a66e6831 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-03-26 00:02:41,929 a66e6831 MainThread dpb_wordcount_benchmark(1/1) INFO Provisioning resources for benchmark dpb_wordcount_benchmark
2017-03-26 00:02:41,932 a66e6831 MainThread dpb_wordcount_benchmark(1/1) INFO Preparing benchmark dpb_wordcount_benchmark
2017-03-26 00:02:41,932 a66e6831 MainThread dpb_wordcount_benchmark(1/1) INFO Running benchmark dpb_wordcount_benchmark
2017-03-26 00:02:41,941 a66e6831 MainThread dpb_wordcount_benchmark(1/1) ERROR Error during benchmark dpb_wordcount_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 510, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 426, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/dpb_wordcount_benchmark.py",> line 162, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 115, in SubmitJob
stdout, _, _ = vm_util.IssueCommand(cmd)
File "<https://builds.apache.org/job/beam_PerformanceTests_Dataflow/ws/PerfKitBenchmarker/perfkitbenchmarker/vm_util.py",> line 287, in IssueCommand
full_cmd = ' '.join(cmd)
TypeError: sequence item 2: expected string, NoneType found
2017-03-26 00:02:41,943 a66e6831 MainThread dpb_wordcount_benchmark(1/1) ERROR Benchmark 1/1 dpb_wordcount_benchmark (UID: dpb_wordcount_benchmark0) failed. Execution will continue.
2017-03-26 00:02:41,966 a66e6831 MainThread INFO Benchmark run statuses:
---------------------------------------------------------
Name UID Status
---------------------------------------------------------
dpb_wordcount_benchmark dpb_wordcount_benchmark0 FAILED
---------------------------------------------------------
Success rate: 0.00% (0/1)
2017-03-26 00:02:41,967 a66e6831 MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/a66e6831/pkb.log
Build step 'Execute shell' marked build as failure