You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2019/04/15 06:22:34 UTC
Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT_HDFS
#1221
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/1221/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/>
No credentials specified
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 98faabff70b58935b7cbc7efeacc8ec1a850479d (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 98faabff70b58935b7cbc7efeacc8ec1a850479d
Commit message: "[BEAM-6942] Make modifications to pipeline options to be visible to all views. (#8225)"
> git rev-list --no-walk 98faabff70b58935b7cbc7efeacc8ec1a850479d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7654443520141365581.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format: "default"
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7526949325040938233.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1221>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2213636199888950029.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1221> create namespace beam-performancetests-parquetioit-hdfs-1221
namespace/beam-performancetests-parquetioit-hdfs-1221 created
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2936260369201472589.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1221> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-parquetioit-hdfs-1221
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8547074113912052006.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1117346892464306160.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins439653567088937732.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2502220599041593234.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3)
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7646475143380194522.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8813020110508261671.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt>
Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 14))
Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz
Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 15))
Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0)
Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 17))
Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl
Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 18))
Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz
Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 19))
Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz
Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 20))
Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz
Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 21))
Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl
Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 22))
Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl
Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 23))
Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz
Complete output from command python setup.py egg_info:
This backport is for Python 2.7 only.
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-tbo3fmdx/functools32/
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal :
beam_PerformanceTests_ParquetIOIT_HDFS #1229
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/1229/display/redirect>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT_HDFS
#1228
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/1228/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-7011] Clean-up Flink portable runner to not reference removed URN.
[kenn] Remove obsolete GenericRecord to BeamRow conversion code
[kenn] Put BigQuery-specific AvroUtils in with BigQueryUtils to avoid confusion
[kenn] Reject BigQuery data with sub-millisecond precision, instead of losing
[daniel.o.programmer] [BEAM-7068] Improving error messages when binding functions in Go SDK
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-2 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 21f1b0dab7ccb35f04bf0a0dc908f45c19a5d8c7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 21f1b0dab7ccb35f04bf0a0dc908f45c19a5d8c7
Commit message: "Merge pull request #8298 from youngoli/beam7068"
> git rev-list --no-walk a91516cd10d382d1c8a42f3e3b373fbad46369f6 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9202570048396208851.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format: "default"
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins398443801408293629.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1228>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8554473082037066502.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1228> create namespace beam-performancetests-parquetioit-hdfs-1228
namespace/beam-performancetests-parquetioit-hdfs-1228 created
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8625807801963399010.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1228> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-parquetioit-hdfs-1228
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1102533872348790578.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2310619594983709608.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins473059578776860053.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins787251899204231275.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3)
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3235881824595133156.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7372816581708630231.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt>
Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 14))
Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz
Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 15))
Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0)
Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 17))
Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl
Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 18))
Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz
Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 19))
Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz
Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 20))
Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz
Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 21))
Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl
Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 22))
Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl
Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 23))
Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz
Complete output from command python setup.py egg_info:
This backport is for Python 2.7 only.
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-sen0b85_/functools32/
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT_HDFS
#1227
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/1227/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-6957] Spark portable runner: support metrics
[iemejia] [BEAM-7080] Remove unused class KinesisUploader from KinesisIO
[aromanenko.dev] [BEAM-6732] Added "Write.withResults()"
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision a91516cd10d382d1c8a42f3e3b373fbad46369f6 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f a91516cd10d382d1c8a42f3e3b373fbad46369f6
Commit message: "Merge pull request #8294: [BEAM-6957] Spark portable runner: support metrics"
> git rev-list --no-walk 4c322107ca5ebc0ab1cc6581d957501fd3ed9cc4 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins774151280747558140.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format: "default"
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3066775542642624936.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1227>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5535893499255654868.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1227> create namespace beam-performancetests-parquetioit-hdfs-1227
namespace/beam-performancetests-parquetioit-hdfs-1227 created
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7001648858549623788.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1227> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-parquetioit-hdfs-1227
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins14435312189635610.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins54607028858190124.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7048394386258889432.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8920730408879954443.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3)
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5683045888591015875.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8843251345780477369.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt>
Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 14))
Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz
Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 15))
Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0)
Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 17))
Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl
Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 18))
Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz
Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 19))
Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz
Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 20))
Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz
Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 21))
Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl
Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 22))
Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl
Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 23))
Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz
Complete output from command python setup.py egg_info:
This backport is for Python 2.7 only.
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-hv738u9f/functools32/
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT_HDFS
#1226
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/1226/display/redirect?page=changes>
Changes:
[michal.walenia] [BEAM-6963] Added Jenkins jobs running Java examples on Dataflow with
[michal.walenia] [BEAM-6936] Refactor of the Portability API examples check, both
[heejong] [BEAM-6747] Adding ExternalTransform in JavaSDK
[thw] [BEAM-6993] Ignore missing artifacts dir during cleanup
[iemejia] [BEAM-7077] Update hamcrest to version 2.1
[iemejia] [BEAM-7077] Update uses of Matchers.isIn(foo) to new
[iemejia] [BEAM-7077] Fix compilation issues because of hamcrest 2.x API changes
[iemejia] [BEAM-7077] Update tests to match the strings of Hamcrest 2.1
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-9 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 4c322107ca5ebc0ab1cc6581d957501fd3ed9cc4 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4c322107ca5ebc0ab1cc6581d957501fd3ed9cc4
Commit message: "Merge pull request #7954 from ihji/BEAM-6747"
> git rev-list --no-walk e390d3c4fc7b71cedb36fc473d25221a9bb854d7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2859243593994291797.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format: "default"
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2726864280331186628.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1226>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7077602333167542824.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1226> create namespace beam-performancetests-parquetioit-hdfs-1226
namespace/beam-performancetests-parquetioit-hdfs-1226 created
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3983440661848393000.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1226> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-parquetioit-hdfs-1226
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2063180538614417539.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins680539544142266362.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1190669354281833646.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6918799166651933362.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3)
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3371423683513147554.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3431749371824288865.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt>
Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 14))
Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz
Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 15))
Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0)
Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 17))
Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl
Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 18))
Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz
Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 19))
Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz
Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 20))
Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz
Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 21))
Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl
Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 22))
Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl
Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 23))
Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz
Complete output from command python setup.py egg_info:
This backport is for Python 2.7 only.
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-eno01y0o/functools32/
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT_HDFS
#1225
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/1225/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-9 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e390d3c4fc7b71cedb36fc473d25221a9bb854d7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e390d3c4fc7b71cedb36fc473d25221a9bb854d7
Commit message: "[BEAM-7063] Enable passing in the worker jar for all tests. (#8313)"
> git rev-list --no-walk e390d3c4fc7b71cedb36fc473d25221a9bb854d7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5011774361664918293.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format: "default"
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5111864106104143317.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1225>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5814657294856310216.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1225> create namespace beam-performancetests-parquetioit-hdfs-1225
namespace/beam-performancetests-parquetioit-hdfs-1225 created
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4925625096083896663.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1225> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-parquetioit-hdfs-1225
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1851254523370755465.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4843790796491870462.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7126231638958369929.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3105746997200121846.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3)
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins2366314304369601442.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1015962445233437456.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt>
Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 14))
Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz
Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 15))
Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0)
Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 17))
Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl
Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 18))
Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz
Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 19))
Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz
Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 20))
Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz
Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 21))
Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl
Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 22))
Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl
Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 23))
Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz
Complete output from command python setup.py egg_info:
This backport is for Python 2.7 only.
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-nz6mgo3h/functools32/
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT_HDFS
#1224
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/1224/display/redirect?page=changes>
Changes:
[amaliujia] [BEAM-7051] Support LIMIT OFFSET.
[kcweaver] [BEAM-7052] add optional environmentType and environmentConfig
[pabloem] [BEAM-3072] Python command error handling improvements (#8158)
[github] [BEAM-7063] Enable passing in the worker jar for all tests. (#8313)
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-9 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e390d3c4fc7b71cedb36fc473d25221a9bb854d7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e390d3c4fc7b71cedb36fc473d25221a9bb854d7
Commit message: "[BEAM-7063] Enable passing in the worker jar for all tests. (#8313)"
> git rev-list --no-walk 2581565fe96f2a1b4be01993831898afefb3e4c7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins442425121843518761.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format: "default"
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8268133888929298094.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1224>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8015476572197804102.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1224> create namespace beam-performancetests-parquetioit-hdfs-1224
namespace/beam-performancetests-parquetioit-hdfs-1224 created
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1541420065697177998.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1224> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-parquetioit-hdfs-1224
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6159190785017663288.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5501351222663761487.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3917658300714234038.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5834309068334556876.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3)
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7215877744835656002.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6035770418163076523.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt>
Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 14))
Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz
Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 15))
Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0)
Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 17))
Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl
Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 18))
Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz
Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 19))
Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz
Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 20))
Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz
Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 21))
Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl
Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 22))
Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl
Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 23))
Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz
Complete output from command python setup.py egg_info:
This backport is for Python 2.7 only.
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-v5g56xs7/functools32/
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT_HDFS
#1223
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/1223/display/redirect>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-9 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2581565fe96f2a1b4be01993831898afefb3e4c7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2581565fe96f2a1b4be01993831898afefb3e4c7
Commit message: "Merge pull request #8293: [BEAM-7067] Make cleanArtifactsPerJob configurable for Flink job server Gradle task"
> git rev-list --no-walk 2581565fe96f2a1b4be01993831898afefb3e4c7 # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8162873715296646455.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format: "default"
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins3535301854865967339.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1223>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9103112671311652763.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1223> create namespace beam-performancetests-parquetioit-hdfs-1223
namespace/beam-performancetests-parquetioit-hdfs-1223 created
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4870902107447554455.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1223> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-parquetioit-hdfs-1223
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1573210267417912729.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins859827854526291905.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4268770008128420014.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6521117871767820243.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3)
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins1587684317609950148.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7556045094254197098.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt>
Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 14))
Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz
Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 15))
Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0)
Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 17))
Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl
Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 18))
Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz
Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 19))
Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz
Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 20))
Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz
Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 21))
Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl
Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 22))
Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl
Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 23))
Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz
Complete output from command python setup.py egg_info:
This backport is for Python 2.7 only.
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-nmfjo27_/functools32/
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_ParquetIOIT_HDFS
#1222
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/1222/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-7067] make cleanArtifactsPerJob configurable for Flink job server
[iemejia] [BEAM-7075] Create Redis embedded server on @BeforeClass and simplify
[iemejia] [BEAM-7076] Update Spark runner to use spark version 2.4.1
[iemejia] [BEAM-7076] Multiple static analysis fixes on Spark runner
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-9 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 2581565fe96f2a1b4be01993831898afefb3e4c7 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 2581565fe96f2a1b4be01993831898afefb3e4c7
Commit message: "Merge pull request #8293: [BEAM-7067] Make cleanArtifactsPerJob configurable for Flink job server Gradle task"
> git rev-list --no-walk 98faabff70b58935b7cbc7efeacc8ec1a850479d # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins6876477718453811527.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format: "default"
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins738855815684466720.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1222>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5002510969430970776.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1222> create namespace beam-performancetests-parquetioit-hdfs-1222
namespace/beam-performancetests-parquetioit-hdfs-1222 created
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8957961443764796835.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/config-beam-performancetests-parquetioit-hdfs-1222> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-parquetioit-hdfs-1222
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins8172938957750601038.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins571589140154114679.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7868829821974887460.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env>
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins7764802012401302125.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (41.0.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python3.5/site-packages (19.0.3)
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins4732605481033515882.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_ParquetIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins5861729795631492955.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt>
Collecting absl-py (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 14))
Using cached https://files.pythonhosted.org/packages/da/3f/9b0355080b81b15ba6a9ffcf1f5ea39e307a2778b2f2dc8694724e8abd5b/absl-py-0.7.1.tar.gz
Collecting jinja2>=2.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 15))
Using cached https://files.pythonhosted.org/packages/1d/e7/fd8b501e7a6dfe492a433deb7b9d833d39ca74916fa8bc63dd1a4947a671/Jinja2-2.10.1-py2.py3-none-any.whl
Requirement already satisfied: setuptools in ./env/.perfkit_env/lib/python3.5/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (41.0.0)
Collecting colorlog[windows]==2.6.0 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 17))
Using cached https://files.pythonhosted.org/packages/59/1a/46a1bf2044ad8b30b52fed0f389338c85747e093fe7f51a567f4cb525892/colorlog-2.6.0-py2.py3-none-any.whl
Collecting blinker>=1.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 18))
Using cached https://files.pythonhosted.org/packages/1b/51/e2a9f3b757eb802f61dc1f2b09c8c99f6eb01cf06416c0671253536517b6/blinker-1.4.tar.gz
Collecting futures>=3.0.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 19))
Using cached https://files.pythonhosted.org/packages/cc/26/b61e3a4eb50653e8a7339d84eeaa46d1e93b92951978873c220ae64d0733/futures-3.1.1.tar.gz
Collecting PyYAML==3.12 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 20))
Using cached https://files.pythonhosted.org/packages/4a/85/db5a2df477072b2902b0eb892feb37d88ac635d36245a72a6a69b23b383a/PyYAML-3.12.tar.gz
Collecting pint>=0.7 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 21))
Using cached https://files.pythonhosted.org/packages/15/9d/bf177ebbc57d25e9e296addc14a1303d1e34d7964af5df428a8332349c42/Pint-0.9-py2.py3-none-any.whl
Collecting numpy==1.13.3 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 22))
Using cached https://files.pythonhosted.org/packages/0d/41/6c224571decd61c2578baedfdb0eec6283617c6679c35b20973f4e68aeaf/numpy-1.13.3-cp35-cp35m-manylinux1_x86_64.whl
Collecting functools32 (from -r <https://builds.apache.org/job/beam_PerformanceTests_ParquetIOIT_HDFS/ws/PerfKitBenchmarker/requirements.txt> (line 23))
Using cached https://files.pythonhosted.org/packages/c5/60/6ac26ad05857c601308d8fb9e87fa36d0ebf889423f47c3502ef034365db/functools32-3.2.3-2.tar.gz
Complete output from command python setup.py egg_info:
This backport is for Python 2.7 only.
----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-install-6d_20bsv/functools32/
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org