You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/09/07 00:16:30 UTC

Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat #728

See <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/728/display/redirect?page=changes>

Changes:

[herohde] [BEAM-5327] Add support for custom dataflow worker jar in Go

------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam8 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/>
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 932858ece39fb2477baa19638f0a6b36fb5dee9d (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 932858ece39fb2477baa19638f0a6b36fb5dee9d
Commit message: "[BEAM-5327] Add support for custom dataflow worker jar in Go"
 > git rev-list --no-walk fb23c7f2eacee5374cfd85a58d5d6746e18fabc7 # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3613591266775165994.sh
+ gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug
DEBUG: Running [gcloud.container.clusters.get-credentials] with arguments: [--verbosity: "debug", --zone: "us-central1-a", NAME: "io-datastores"]
Fetching cluster endpoint and auth data.
DEBUG: Saved kubeconfig to /home/jenkins/.kube/config
kubeconfig entry generated for io-datastores.
INFO: Display format "default".
DEBUG: SDK update checks are disabled.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2455567110849991123.sh
+ cp /home/jenkins/.kube/config <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-728>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins750101194102595772.sh
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-728> create namespace beam-performancetests-hadoopinputformat-728
namespace "beam-performancetests-hadoopinputformat-728" created
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins3564399106690937007.sh
++ kubectl config current-context
+ kubectl --kubeconfig=<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/config-beam-performancetests-hadoopinputformat-728> config set-context gke_apache-beam-testing_us-central1-a_io-datastores --namespace=beam-performancetests-hadoopinputformat-728
Context "gke_apache-beam-testing_us-central1-a_io-datastores" modified.
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins6493528747475411356.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1693341593609202532.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins1756669024011233756.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8253766152346778497.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env>
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins5722928265710338896.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env>
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python2>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.perfkit_env/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins4017970921462497814.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install --upgrade grpcio-tools==1.3.5
Collecting grpcio-tools==1.3.5
  Using cached https://files.pythonhosted.org/packages/05/f6/0296e29b1bac6f85d2a8556d48adf825307f73109a3c2c17fb734292db0a/grpcio_tools-1.3.5-cp27-cp27mu-manylinux1_x86_64.whl
Collecting grpcio>=1.3.5 (from grpcio-tools==1.3.5)
  Using cached https://files.pythonhosted.org/packages/bd/a6/4bad0d1a49071363dc6547a5178656fe375c80535128c12bb65c59d1a329/grpcio-1.14.2-cp27-cp27mu-manylinux1_x86_64.whl
Collecting protobuf>=3.2.0 (from grpcio-tools==1.3.5)
  Using cached https://files.pythonhosted.org/packages/b8/c2/b7f587c0aaf8bf2201405e8162323037fe8d17aa21d3c7dda811b8d01469/protobuf-3.6.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting six>=1.5.2 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
  Using cached https://files.pythonhosted.org/packages/67/4b/141a581104b1f6397bfa78ac9d43d8ad29a7ca43ea90a2d863fe3056e86a/six-1.11.0-py2.py3-none-any.whl
Collecting enum34>=1.0.4 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
  Using cached https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl
Collecting futures>=2.2.0 (from grpcio>=1.3.5->grpcio-tools==1.3.5)
  Using cached https://files.pythonhosted.org/packages/2d/99/b2c4e9d5a30f6471e410a146232b4118e697fa3ffc06d6a65efde84debd0/futures-3.2.0-py2-none-any.whl
Requirement already satisfied, skipping upgrade: setuptools in ./env/.beam_env/lib/python2.7/site-packages (from protobuf>=3.2.0->grpcio-tools==1.3.5) (40.2.0)
Installing collected packages: six, enum34, futures, grpcio, protobuf, grpcio-tools
Successfully installed enum34-1.1.6 futures-3.2.0 grpcio-1.14.2 grpcio-tools-1.3.5 protobuf-3.6.1 six-1.11.0
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2688743256408797225.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins8848788728466578364.sh
+ cd <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
+ <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/bin/pip> install -e '.[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python>
    Complete output from command python setup.py egg_info:
    <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/env/.beam_env/local/lib/python2.7/site-packages/setuptools/dist.py>:398: UserWarning: Normalizing '2.8.0.dev' to '2.8.0.dev0'
      normalized_version,
    running egg_info
    Requirement already satisfied: future==0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (0.16.0)
    gapic-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
    proto-google-cloud-datastore-v1 0.90.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
    proto-google-cloud-pubsub-v1 0.15.4 has requirement oauth2client<4.0dev,>=2.0.0, but you'll have oauth2client 4.1.2 which is incompatible.
    googledatastore 7.0.1 has requirement httplib2<0.10,>=0.9.1, but you'll have httplib2 0.11.3 which is incompatible.
    googledatastore 7.0.1 has requirement oauth2client<4.0.0,>=2.0.1, but you'll have oauth2client 4.1.2 which is incompatible.
    You are using pip version 10.0.1, however version 18.0 is available.
    You should consider upgrading via the 'pip install --upgrade pip' command.
    error: [Errno 2] No such file or directory
    
    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in <https://builds.apache.org/job/beam_PerformanceTests_HadoopInputFormat/ws/src/sdks/python/>
Build step 'Execute shell' marked build as failure