You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/07/01 10:37:33 UTC

Build failed in Jenkins: beam_PerformanceTests_Python #48

See <https://builds.apache.org/job/beam_PerformanceTests_Python/48/display/redirect>

------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on beam6 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0e429b33ff85eba08da5018c9febd0b99b44f720 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 0e429b33ff85eba08da5018c9febd0b99b44f720
 > git rev-list 0e429b33ff85eba08da5018c9febd0b99b44f720 # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/hudson6529342162802099299.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/hudson4077271160419505959.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/hudson318531803745068542.sh
+ pip install --user -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied (use --upgrade to upgrade): python-gflags==3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied (use --upgrade to upgrade): jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied (use --upgrade to upgrade): colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
  Installing extra requirements: 'windows'
Requirement already satisfied (use --upgrade to upgrade): blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied (use --upgrade to upgrade): futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied (use --upgrade to upgrade): PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied (use --upgrade to upgrade): pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied (use --upgrade to upgrade): numpy in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied (use --upgrade to upgrade): functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied (use --upgrade to upgrade): contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/hudson868776907272104005.sh
+ pip install --user -e 'sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/sdks/python>
  Running setup.py (path:<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/sdks/python/setup.py)> egg_info for package from file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/sdks/python>
    <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/sdks/python/setup.py>:66: UserWarning: You are using version 1.5.4 of pip. However, version 7.0.0 is recommended.
      _PIP_VERSION, REQUIRED_PIP_VERSION
    no previously-included directories found matching 'doc/.build'
    
    Installed <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/sdks/python/nose-1.3.7-py2.7.egg>
    
    warning: no files found matching 'README.md'
    warning: no files found matching 'NOTICE'
    warning: no files found matching 'LICENSE'
  Installing extra requirements: 'gcp,test'
Requirement already satisfied (use --upgrade to upgrade): avro>=1.8.1,<2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): crcmod>=1.7,<2.0 in /usr/lib/python2.7/dist-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): grpcio>=1.0,<2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): httplib2>=0.8,<0.10 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): mock>=1.0.1,<3.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): oauth2client>=2.0.1,<4.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): protobuf>=3.2.0,<=3.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): pyyaml>=3.12,<4.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): pyhamcrest>=1.9,<2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): six>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): google-apitools>=0.5.10,<=0.5.11 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): proto-google-cloud-datastore-v1>=0.90.0,<=0.90.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): google-cloud-pubsub==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): google-cloud-bigquery>=0.23.0,<0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): futures>=2.2.0 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.0,<2.0->apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio>=1.0,<2.0->apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client>=2.0.1,<4.0.0->apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client>=2.0.1,<4.0.0->apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client>=2.0.1,<4.0.0->apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): setuptools in /usr/lib/python2.7/dist-packages (from protobuf>=3.2.0,<=3.3.0->apache-beam==2.1.0.dev)
Requirement already satisfied (use --upgrade to upgrade): googleapis-common-protos>=1.5.2,<2.0dev in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1>=0.90.0,<=0.90.4->apache-beam==2.1.0.dev)
Installing collected packages: apache-beam
  Running setup.py develop for apache-beam
    <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/sdks/python/setup.py>:66: UserWarning: You are using version 1.5.4 of pip. However, version 7.0.0 is recommended.
      _PIP_VERSION, REQUIRED_PIP_VERSION
    
    warning: no files found matching 'README.md'
    warning: no files found matching 'NOTICE'
    warning: no files found matching 'LICENSE'
    Creating /home/jenkins/.local/lib/python2.7/site-packages/apache-beam.egg-link (link to .)
    apache-beam 2.1.0.dev is already the active version in easy-install.pth
    
    Installed <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/sdks/python>
Successfully installed apache-beam
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/hudson5135332014924134341.sh
+ python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
WARNING:root:File resource loader root perfkitbenchmarker/data/ycsb is not a directory.
2017-07-01 10:37:22,799 dddb33d4 MainThread INFO     Verbose logging to: /tmp/perfkitbenchmarker/runs/dddb33d4/pkb.log
2017-07-01 10:37:22,799 dddb33d4 MainThread INFO     PerfKitBenchmarker version: v1.12.0-53-ga07b524
2017-07-01 10:37:22,800 dddb33d4 MainThread INFO     Flag values:
--beam_sdk=python
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2017-07-01 10:37:23,028 dddb33d4 MainThread WARNING  The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2017-07-01 10:37:23,122 dddb33d4 MainThread beam_integration_benchmark(1/1) INFO     Provisioning resources for benchmark beam_integration_benchmark
2017-07-01 10:37:23,125 dddb33d4 MainThread beam_integration_benchmark(1/1) INFO     Preparing benchmark beam_integration_benchmark
2017-07-01 10:37:23,125 dddb33d4 MainThread beam_integration_benchmark(1/1) INFO     Running: git clone https://github.com/apache/beam.git
2017-07-01 10:37:27,519 dddb33d4 MainThread beam_integration_benchmark(1/1) ERROR    Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 555, in RunBenchmark
    DoPreparePhase(spec, detailed_timer)
  File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 450, in DoPreparePhase
    spec.BenchmarkPrepare(spec)
  File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 91, in Prepare
    beam_benchmark_helper.InitializeBeamRepo(benchmark_spec)
  File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 136, in InitializeBeamRepo
    mvn_command)
TypeError: AddRunnerProfileMvnArgument() takes exactly 3 arguments (2 given)
2017-07-01 10:37:27,522 dddb33d4 MainThread beam_integration_benchmark(1/1) ERROR    Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2017-07-01 10:37:27,571 dddb33d4 MainThread INFO     Benchmark run statuses:
---------------------------------------------------------------
Name                        UID                          Status
---------------------------------------------------------------
beam_integration_benchmark  beam_integration_benchmark0  FAILED
---------------------------------------------------------------
Success rate: 0.00% (0/1)
2017-07-01 10:37:27,572 dddb33d4 MainThread INFO     Complete logs can be found at: /tmp/perfkitbenchmarker/runs/dddb33d4/pkb.log
2017-07-01 10:37:27,572 dddb33d4 MainThread INFO     Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/dddb33d4/completion_statuses.json
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user sisk@google.com
Not sending mail to unregistered user mairbek@google.com