You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/09/09 06:16:28 UTC
Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat
#737
See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/737/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8806864450742463320.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7897417078884526867.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-737>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins4693266026481651720.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-737> create namespace beam-performancetests-hadoopinputformat-737
namespace "beam-performancetests-hadoopinputformat-737" created
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2267893611018293048.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-737> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-hadoopinputformat-737
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5524459351299051364.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1921630061629890186.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2449596790847657769.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3339167345784908910.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3300903018751647760.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1401079591434535324.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2460989924400129050.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7366208529584304440.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins713838147306681878.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Jenkins build is back to normal :
beam_PerformanceTests_HadoopInputFormat #746
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/746/display/redirect?page=changes>
Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat
#745
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/745/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 520b3a24e49306c30940ceab09100d775a04d28e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 520b3a24e49306c30940ceab09100d775a04d28e
Commit message: "Merge pull request #6359 from RobbeSneyders/transforms"
> git rev-list --no-walk 520b3a24e49306c30940ceab09100d775a04d28e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6506646917187024873.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1220011582528355010.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-745>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8740179831655423094.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-745> create namespace beam-performancetests-hadoopinputformat-745
namespace "beam-performancetests-hadoopinputformat-745" created
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins9051108544771125644.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-745> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-hadoopinputformat-745
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5295353596637654189.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3036593766176462067.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5362169067379895548.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2969698167650681547.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7410108139772384768.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7329175075620161964.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2988283824307712667.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3560603155215173075.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5018310637304641291.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat
#744
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/744/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-5149] Add support for the Java SDK harness to merge windows.
[lcwik] Address PR comments.
[lcwik] [BEAM-5351] Fix missing pom.xml file in artifact jar.
[robbe.sneyders] remove sys.exc_clear()
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam2 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/>
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 520b3a24e49306c30940ceab09100d775a04d28e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 520b3a24e49306c30940ceab09100d775a04d28e
Commit message: "Merge pull request #6359 from RobbeSneyders/transforms"
> git rev-list --no-walk 9b68f926628d727e917b6a33ccdafcfe693eef6a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8706305400860841674.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1941614181386313177.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-744>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3659635801355428188.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-744> create namespace beam-performancetests-hadoopinputformat-744
namespace "beam-performancetests-hadoopinputformat-744" created
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2972979715092513029.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-744> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-hadoopinputformat-744
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3696046838267148450.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2514818629715586537.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7304261387971913998.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2426513700246789211.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7274933407611809372.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins4994126502103774907.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2335003004307284250.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins9135759644234486505.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1268181434906850659.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat
#743
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/743/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 9b68f926628d727e917b6a33ccdafcfe693eef6a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 9b68f926628d727e917b6a33ccdafcfe693eef6a
Commit message: "Merge pull request #6314 from robertwb/update-tf"
> git rev-list --no-walk 9b68f926628d727e917b6a33ccdafcfe693eef6a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7504784027004941566.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8484248952634982028.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-743>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3461343936607927363.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-743> create namespace beam-performancetests-hadoopinputformat-743
namespace "beam-performancetests-hadoopinputformat-743" created
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6395711684164606128.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-743> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-hadoopinputformat-743
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3907105006210789899.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7110679532579415379.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3568245312436595277.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3652148321867764515.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1424007409418261692.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins4710764177719291667.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1681891854167123200.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins940503092153110313.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5239167323037772138.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat
#742
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/742/display/redirect?page=changes>
Changes:
[robertwb] Update container versions of NumPy and TensorFlow.
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 9b68f926628d727e917b6a33ccdafcfe693eef6a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 9b68f926628d727e917b6a33ccdafcfe693eef6a
Commit message: "Merge pull request #6314 from robertwb/update-tf"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6791027702994767185.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins39056233700619860.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-742>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins4345323373028611374.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-742> create namespace beam-performancetests-hadoopinputformat-742
namespace "beam-performancetests-hadoopinputformat-742" created
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8679156788730329630.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-742> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-hadoopinputformat-742
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins312952749466056244.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5846143245387903704.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins39994843439909571.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8737159055613648167.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins570442234057040285.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1786373678221677516.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8634848426037552878.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8907728430778787367.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2689362094893315774.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat
#741
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/741/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8101583075538740826.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5993396116889894107.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-741>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5499402439165728643.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-741> create namespace beam-performancetests-hadoopinputformat-741
namespace "beam-performancetests-hadoopinputformat-741" created
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins4891684701221530533.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-741> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-hadoopinputformat-741
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3626082949859087537.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8686304239402836350.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5383118881350361645.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2596480428976428947.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins4815577250657019977.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7729282705507590834.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3516368797789477770.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins9008254054676582495.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7523853081068420006.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat
#740
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/740/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3799290938484709512.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5584245490702035188.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-740>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7831524204978557201.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-740> create namespace beam-performancetests-hadoopinputformat-740
namespace "beam-performancetests-hadoopinputformat-740" created
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2142562958508744074.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-740> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-hadoopinputformat-740
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5475976709357586641.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1433485675182124043.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins4047315768875204645.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6791309591312548273.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5892489012061152467.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5671977004221773665.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2887783830592071759.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3357429170878535244.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6486272812224293844.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat
#739
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/739/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6314512099680334691.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2256854337122441526.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-739>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6544901878755937645.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-739> create namespace beam-performancetests-hadoopinputformat-739
namespace "beam-performancetests-hadoopinputformat-739" created
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2031309609140364606.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-739> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-hadoopinputformat-739
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7805152227935523048.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins4356422781812234264.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8002913630561370966.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8462516954941311952.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6486069771664962449.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6216475433200734237.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6037681166457778698.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2143199220457348892.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5638352540295241891.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat
#738
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/738/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3326231739787844801.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8389401630235628383.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-738>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6878233388248002228.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-738> create namespace beam-performancetests-hadoopinputformat-738
namespace "beam-performancetests-hadoopinputformat-738" created
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7053395529202431576.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-738> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-hadoopinputformat-738
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6668952508309840163.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins7284832364393540603.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins4175119482200240610.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3384154891946885131.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8895389702715980990.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6956403159760984080.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1608524387790951049.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1228699210879744766.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8281327493404281564.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure