You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/09/06 12:06:29 UTC
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #625
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/625/display/redirect?page=changes>
Changes:
[dattran] [BEAM-5107] Add support for ES-6.x to ElasticsearchIO
[mxm] Fixing bug in flink job server creation
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fb23c7f2eacee5374cfd85a58d5d6746e18fabc7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fb23c7f2eacee5374cfd85a58d5d6746e18fabc7
Commit message: "Fixing bug in flink job server creation"
> git rev-list --no-walk 519e91e6de516a2800b23bec77a78acf8b94f075 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1407762860921874623.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3053532215314126382.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-625>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5834383644950019714.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-625> create namespace beam-performancetests-avroioit-hdfs-625
namespace "beam-performancetests-avroioit-hdfs-625" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7440306650403443632.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-625> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-625
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7376891659160879270.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2124828169958529213.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5101221920276681342.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1306572709382180327.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5848764024444349030.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1723817367428898995.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6552666669192049620.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4360240232503241929.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6710769830965039801.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Jenkins build is back to normal :
beam_PerformanceTests_AvroIOIT_HDFS #645
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/645/display/redirect?page=changes>
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #644
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/644/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 520b3a24e49306c30940ceab09100d775a04d28e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 520b3a24e49306c30940ceab09100d775a04d28e
Commit message: "Merge pull request #6359 from RobbeSneyders/transforms"
> git rev-list --no-walk 520b3a24e49306c30940ceab09100d775a04d28e # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1212204716871595279.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2995218526390939469.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-644>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8208954137905729969.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-644> create namespace beam-performancetests-avroioit-hdfs-644
namespace "beam-performancetests-avroioit-hdfs-644" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2959627491527220334.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-644> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-644
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8182461595505209995.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6862582391462345178.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6480872230614376888.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4902483118552918050.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9073249698566952559.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7063296266707749322.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3991164399551861650.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8827150040598010290.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1209751179215115195.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #643
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/643/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-5149] Add support for the Java SDK harness to merge windows.
[lcwik] Address PR comments.
[lcwik] [BEAM-5351] Fix missing pom.xml file in artifact jar.
[robbe.sneyders] remove sys.exc_clear()
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 520b3a24e49306c30940ceab09100d775a04d28e (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 520b3a24e49306c30940ceab09100d775a04d28e
Commit message: "Merge pull request #6359 from RobbeSneyders/transforms"
> git rev-list --no-walk 9b68f926628d727e917b6a33ccdafcfe693eef6a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5785245306353565502.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7691945411089432059.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-643>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5668741766207027014.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-643> create namespace beam-performancetests-avroioit-hdfs-643
namespace "beam-performancetests-avroioit-hdfs-643" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4011417581149317072.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-643> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-643
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2865903012018829124.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7550993950727384482.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins591109475310978141.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7762866131322983717.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins789886237253225848.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7443471273825539922.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4219329619403451217.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7347991906441217835.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2148588147557322452.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #642
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/642/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 9b68f926628d727e917b6a33ccdafcfe693eef6a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 9b68f926628d727e917b6a33ccdafcfe693eef6a
Commit message: "Merge pull request #6314 from robertwb/update-tf"
> git rev-list --no-walk 9b68f926628d727e917b6a33ccdafcfe693eef6a # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1580624620719641311.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4763922537797207236.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-642>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7031348424868667371.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-642> create namespace beam-performancetests-avroioit-hdfs-642
namespace "beam-performancetests-avroioit-hdfs-642" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins316109934772395654.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-642> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-642
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7145263342513840781.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3078991979047400758.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2649206242513983963.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8768027668979416484.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8512232448239423640.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3015464589411932394.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8149784911367974607.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4226593298458990141.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6051683787804334569.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #641
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/641/display/redirect?page=changes>
Changes:
[robertwb] Update container versions of NumPy and TensorFlow.
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 9b68f926628d727e917b6a33ccdafcfe693eef6a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 9b68f926628d727e917b6a33ccdafcfe693eef6a
Commit message: "Merge pull request #6314 from robertwb/update-tf"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6038842799701185546.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6361321308753753115.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-641>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7733001872214885745.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-641> create namespace beam-performancetests-avroioit-hdfs-641
namespace "beam-performancetests-avroioit-hdfs-641" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6211053778085774444.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-641> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-641
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5309830967183603696.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4536001452335230659.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4210053907435795122.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7276644622131065145.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6775323269375008763.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8780805275394294629.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3013355524528417596.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8636583861380455134.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1203121323550318860.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #640
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/640/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2572324294961660750.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8371431158554384240.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-640>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6761492685526800039.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-640> create namespace beam-performancetests-avroioit-hdfs-640
namespace "beam-performancetests-avroioit-hdfs-640" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7749552856466371408.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-640> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-640
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins609017070140891093.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5025984416382470402.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6272455029951728162.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins729931110575392007.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2403955107706437811.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6902838173007808199.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1649392955751356938.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins481846341647280978.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3403975476931551926.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #639
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/639/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam12 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4066668817223425205.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7840937391636350839.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-639>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins65858212896482141.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-639> create namespace beam-performancetests-avroioit-hdfs-639
namespace "beam-performancetests-avroioit-hdfs-639" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2587561566237902386.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-639> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-639
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins913151662829225144.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9045515796477768847.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins121547924252151206.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4938398093486664447.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5629801335004398832.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5293438862885521663.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Collecting grpcio>=1.3.5 (from grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/bd/a6/4bad0d1a49071363dc6547a5178656fe375c80535128c12bb65c59d1a329/grpcio-1.14.2-cp27-cp27mu-manylinux1_x86_64.whl
Collecting protobuf>=3.2.0 (from grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/b8/c2/b7f587c0aaf8bf2201405e8162323037fe8d17aa21d3c7dda811b8d01469/protobuf-3.6.1-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Collecting futures>=2.2.0 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl
Installing collected packages: futures, grpcio, protobuf, grpcio-tools
Successfully installed futures-3.2.0 grpcio-1.14.2 grpcio-tools-1.3.5 protobuf-3.6.1
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2877903908100108550.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6542359263187234737.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4983298215938426163.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Collecting future==0.16.0
Installing collected packages: future
Could not install packages due to an EnvironmentError: [Errno 13] Permission denied: '/usr/local/lib/python2.7/dist-packages/_markupbase'
Consider using the `--user` option or check the permissions.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/setup.py",> line 230, in <module>
'test': generate_protos_first(test),
File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/__init__.py",> line 140, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/setup.py",> line 164, in run
gen_protos.generate_proto_files()
File "gen_protos.py", line 119, in generate_proto_files
'Error installing future during proto generation')
RuntimeError: Error installing future during proto generation
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #638
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/638/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2551177132827455424.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1581790060987019889.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-638>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7537653290138738487.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-638> create namespace beam-performancetests-avroioit-hdfs-638
namespace "beam-performancetests-avroioit-hdfs-638" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1397014167164988135.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-638> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-638
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5290548056744669502.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4625620515175213355.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5548869555894343081.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2417371885071246557.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5826183588877227743.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7030228000518918740.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8319974594963747249.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1387384247661926316.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2485646375425043962.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #637
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/637/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6681368149731402346.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2198281956797352381.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-637>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9124135229501501552.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-637> create namespace beam-performancetests-avroioit-hdfs-637
namespace "beam-performancetests-avroioit-hdfs-637" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1725986392751612749.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-637> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-637
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins870923584214561306.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1819168935860370897.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4427449875786893245.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins436293610240605176.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2309382469180281031.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3083208111471177560.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7106818865035120961.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3684164004411693538.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8929059586291833408.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #636
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/636/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7139796152003070097.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7366528471466700099.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-636>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5204576050505714314.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-636> create namespace beam-performancetests-avroioit-hdfs-636
namespace "beam-performancetests-avroioit-hdfs-636" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6744072603566574855.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-636> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-636
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins372936829315877349.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6931265325577932194.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4309668504093990724.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5155296324669584514.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins386846965161635888.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1417242661630735121.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6963182320019821319.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6487346149852673785.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2467340435617099204.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #635
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/635/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8030884536962863754.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4945967736531879914.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-635>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3527631435226817488.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-635> create namespace beam-performancetests-avroioit-hdfs-635
namespace "beam-performancetests-avroioit-hdfs-635" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8055075354043265485.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-635> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-635
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1240108274794070443.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6248598555129306296.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7680217399537135138.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1833710556745754435.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3005411050912645345.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1537196361759201385.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins812225212921828167.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1459841528142617458.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4174131409986204366.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #634
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/634/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7054778613628456307.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8150136199075872762.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-634>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins204796061158934742.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-634> create namespace beam-performancetests-avroioit-hdfs-634
namespace "beam-performancetests-avroioit-hdfs-634" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2183987457761703072.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-634> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-634
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7165327857708035849.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2119189644193570828.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4816815762546331793.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3541868784876695696.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5554341094590210502.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins261725524170850230.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3552555111107160582.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7386081672857264707.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3241538683251826569.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #633
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/633/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4279361848592285434.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4118036764747111403.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-633>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5625782489898394170.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-633> create namespace beam-performancetests-avroioit-hdfs-633
namespace "beam-performancetests-avroioit-hdfs-633" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9155388613188422997.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-633> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-633
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5633759264451002279.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins473414144991502919.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4089147400259575789.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4071883549140073206.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4947012770864426253.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins654291041237887005.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7859408201816106821.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8223908507642774221.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8896731406239487816.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #632
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/632/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6aa2cf55376481de83a801cd9d79fb775916ee88 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8945653320506113371.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1026078774662213575.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-632>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins741118183151386492.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-632> create namespace beam-performancetests-avroioit-hdfs-632
namespace "beam-performancetests-avroioit-hdfs-632" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins978758741627744910.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-632> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-632
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2552901426888878144.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7403386673275831257.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8081909930516078431.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6331086660226733633.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8825289497244724864.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6051291833643812597.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5226178356071667714.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2098789557925087444.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8630883626920440302.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #631
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/631/display/redirect?page=changes>
Changes:
[apilloud] [BEAM-5279] Don't wipe SQL metadata, keep types simple
[yifanzou] [BEAM-5301] migrate datastore_worcount integration test to Beam
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6aa2cf55376481de83a801cd9d79fb775916ee88 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6aa2cf55376481de83a801cd9d79fb775916ee88
Commit message: "Merge pull request #6337 from apilloud/metadata"
> git rev-list --no-walk 6df2ef3ec9c835097e79b4441ce47ff09a458894 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins199905315831348654.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7526552456174637914.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-631>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1752914055065944861.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-631> create namespace beam-performancetests-avroioit-hdfs-631
namespace "beam-performancetests-avroioit-hdfs-631" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5500124321835806000.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-631> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-631
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7451875466957568271.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8347455978696542875.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2489822145324197256.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7818575816734646274.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6090351702169464543.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1018353746922938739.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7667854103117520226.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1846222728838648598.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2806879210314795234.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #630
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/630/display/redirect?page=changes>
Changes:
[tweise] [BEAM-5332] Do not attempt to evict cache after shutdown (#6342)
[thw] Cleanup FlinkExecutableStageContext and related classes.
[tweise] Compatibility Matrix: Build 'shadowJar' instead of regular jar (#6348)
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 6df2ef3ec9c835097e79b4441ce47ff09a458894 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 6df2ef3ec9c835097e79b4441ce47ff09a458894
Commit message: "Merge pull request #6345 from tweise/flinkExecutableStageContextCleanup"
> git rev-list --no-walk c34c367f5da6f9bef8a46471195470923a201af9 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1789638054358704711.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6407471823290840858.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-630>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9185167694082346238.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-630> create namespace beam-performancetests-avroioit-hdfs-630
namespace "beam-performancetests-avroioit-hdfs-630" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1427616461214204975.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-630> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-630
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9004562918250614473.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4564989655555173555.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8316349146154607614.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8291121770430943131.sh
+ sh -c 'virtualenv "$WORKSPACE/env/.beam_env"'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins966118454426578670.sh
+ sh -c 'virtualenv "$WORKSPACE/env/.perfkit_env"'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3719248042265229600.sh
+ sh -c '"$WORKSPACE/env/.beam_env"/bin/pip install --upgrade grpcio-tools==1.3.5'
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Collecting grpcio>=1.3.5 (from grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/bd/a6/4bad0d1a49071363dc6547a5178656fe375c80535128c12bb65c59d1a329/grpcio-1.14.2-cp27-cp27mu-manylinux1_x86_64.whl
Collecting protobuf>=3.2.0 (from grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/b8/c2/b7f587c0aaf8bf2201405e8162323037fe8d17aa21d3c7dda811b8d01469/protobuf-3.6.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting six>=1.5.2 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl
Collecting enum34>=1.0.4 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl
Collecting futures>=2.2.0 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl
Requirement already satisfied, skipping upgrade: setuptools in ./env/.beam_env/lib/python2.7/site-packages (from protobuf>=3.2.0->grpcio-tools==1.3.5) (40.2.0)
Installing collected packages: six, enum34, futures, grpcio, protobuf, grpcio-tools
Successfully installed enum34-1.1.6 futures-3.2.0 grpcio-1.14.2 grpcio-tools-1.3.5 protobuf-3.6.1 six-1.11.0
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1708289517156907103.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2149207981585854865.sh
+ sh -c 'cd "$WORKSPACE/src"/sdks/python && "$WORKSPACE/env/.beam_env"/bin/pip install -e .[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #629
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/629/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c34c367f5da6f9bef8a46471195470923a201af9 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c34c367f5da6f9bef8a46471195470923a201af9
Commit message: "Finish Python 3 porting for coders subpackage (#6310)"
> git rev-list --no-walk c34c367f5da6f9bef8a46471195470923a201af9 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins392730060941390705.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1816585116241795128.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-629>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1007182330174070878.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-629> create namespace beam-performancetests-avroioit-hdfs-629
namespace "beam-performancetests-avroioit-hdfs-629" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2506861936185893303.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-629> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-629
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins806222555991394239.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5550207955395871863.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2528466958462899654.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8427839072764112537.sh
+ virtualenv --version
15.0.1
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1547895351183829679.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --no-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2308780486957042439.sh
+ . <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/activate>
++ deactivate nondestructive
++ unset -f pydoc
++ '[' -z '' ']'
++ '[' -z '' ']'
++ '[' -n /bin/bash ']'
++ hash -r
++ '[' -z '' ']'
++ unset VIRTUAL_ENV
++ '[' '!' nondestructive = nondestructive ']'
++ VIRTUAL_ENV=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
++ export VIRTUAL_ENV
++ _OLD_VIRTUAL_PATH=/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
++ PATH=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin>:/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
++ export PATH
++ '[' -z '' ']'
++ '[' -z '' ']'
++ _OLD_VIRTUAL_PS1=
++ '[' x '!=' x ']'
+++ basename <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
++ PS1='(.beam_env) '
++ export PS1
++ alias pydoc
++ '[' -n /bin/bash ']'
++ hash -r
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins918935263445499148.sh
+ which python pip
/usr/bin/python
/usr/local/bin/pip
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7094937910008007076.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Collecting grpcio>=1.3.5 (from grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/bd/a6/4bad0d1a49071363dc6547a5178656fe375c80535128c12bb65c59d1a329/grpcio-1.14.2-cp27-cp27mu-manylinux1_x86_64.whl
Collecting protobuf>=3.2.0 (from grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/b8/c2/b7f587c0aaf8bf2201405e8162323037fe8d17aa21d3c7dda811b8d01469/protobuf-3.6.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting six>=1.5.2 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl
Collecting enum34>=1.0.4 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl
Collecting futures>=2.2.0 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl
Installing collected packages: six, enum34, futures, grpcio, protobuf, grpcio-tools
Successfully installed enum34-1.1.6 futures-3.2.0 grpcio-1.14.2 grpcio-tools-1.3.5 protobuf-3.6.1 six-1.11.0
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5199744452169951565.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #628
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/628/display/redirect?page=changes>
Changes:
[aaltay] Finish Python 3 porting for coders subpackage (#6310)
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision c34c367f5da6f9bef8a46471195470923a201af9 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f c34c367f5da6f9bef8a46471195470923a201af9
Commit message: "Finish Python 3 porting for coders subpackage (#6310)"
> git rev-list --no-walk 932858ece39fb2477baa19638f0a6b36fb5dee9d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6366554002758736142.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7782090308000702640.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-628>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1649624656995935406.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-628> create namespace beam-performancetests-avroioit-hdfs-628
namespace "beam-performancetests-avroioit-hdfs-628" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7559572177220331890.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-628> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-628
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6652571269891520471.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9192659304666090677.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6624566617019895294.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7725633357886893578.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4339481943428035182.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8392483763669663793.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8220323055645897057.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3073455186028313088.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8633893966158970841.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #627
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/627/display/redirect?page=changes>
Changes:
[herohde] [BEAM-5327] Add support for custom dataflow worker jar in Go
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 932858ece39fb2477baa19638f0a6b36fb5dee9d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 932858ece39fb2477baa19638f0a6b36fb5dee9d
Commit message: "[BEAM-5327] Add support for custom dataflow worker jar in Go"
> git rev-list --no-walk fb23c7f2eacee5374cfd85a58d5d6746e18fabc7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1280443240067803478.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8773869929777967418.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-627>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5270974375999191737.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-627> create namespace beam-performancetests-avroioit-hdfs-627
namespace "beam-performancetests-avroioit-hdfs-627" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins753706549494056255.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-627> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-627
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5235306946685929118.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7826784001002842397.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3029761513453049083.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6958257397846994754.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6983871047909062914.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4042585119975445776.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6127735207368603609.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4526186484539458721.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6608112673999352329.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #626
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/626/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision fb23c7f2eacee5374cfd85a58d5d6746e18fabc7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f fb23c7f2eacee5374cfd85a58d5d6746e18fabc7
Commit message: "Fixing bug in flink job server creation"
> git rev-list --no-walk fb23c7f2eacee5374cfd85a58d5d6746e18fabc7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6406137637441002311.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7635973558993639269.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-626>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8770247440624043535.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-626> create namespace beam-performancetests-avroioit-hdfs-626
namespace "beam-performancetests-avroioit-hdfs-626" created
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5205399220761859606.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/config-beam-performancetests-avroioit-hdfs-626> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-avroioit-hdfs-626
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2705688369881566214.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9032336391805743411.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9087967574090363955.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6765912923940019513.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3797916560542756397.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env> --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3222347479531238829.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install --upgrade setuptools pip grpcio-tools==1.3.5
Requirement already up-to-date: setuptools in ./env/.beam_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.beam_env/lib/python2.7/site-packages (18.0)
Collecting grpcio-tools==1.3.5
Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied, skipping upgrade: grpcio>=1.3.5 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (1.13.0)
Requirement already satisfied, skipping upgrade: protobuf>=3.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio-tools==1.3.5) (3.6.0)
Requirement already satisfied, skipping upgrade: six>=1.5.2 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.11.0)
Requirement already satisfied, skipping upgrade: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (1.1.6)
Requirement already satisfied, skipping upgrade: futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.3.5->grpcio-tools==1.3.5) (3.2.0)
Installing collected packages: grpcio-tools
Successfully installed grpcio-tools-1.3.5
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1067129609510353800.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (40.2.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (18.0)
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7196635792483722117.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4309853176463783187.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/bin/pip> install -e '<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/[gcp,test]'>
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python>
Complete output from command python setup.py egg_info:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
normalized_version,
running egg_info
Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
You are using pip version 10.0.1, however version 18.0 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
error: [Errno 2] No such file or directory
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure