You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/04/09 12:08:58 UTC
Build failed in Jenkins: beam_PerformanceTests_Python #1125
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1125/display/redirect>
------------------------------------------
[...truncated 1.74 KB...]
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7495273387771991420.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins4559068290177740191.sh
+ virtualenv .env --system-site-packages
New python executable in .env/bin/python
Installing setuptools, pip...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins3090570650402206204.sh
+ .env/bin/pip install --upgrade setuptools pip
Downloading/unpacking setuptools from https://pypi.python.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl#md5=ca299c7acd13a72e1171a3697f2b99bc
Downloading/unpacking pip from https://pypi.python.org/packages/ac/95/a05b56bb975efa78d3557efa36acaf9cf5d2fd0ee0062060493687432e03/pip-9.0.3-py2.py3-none-any.whl#md5=d512ceb964f38ba31addb8142bc657cb
Installing collected packages: setuptools, pip
Found existing installation: setuptools 2.2
Uninstalling setuptools:
Successfully uninstalled setuptools
Found existing installation: pip 1.5.4
Uninstalling pip:
Successfully uninstalled pip
Successfully installed setuptools pip
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1809729280594619375.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins8871607583233206470.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied: numpy==1.13.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied: functools32 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /usr/local/lib/python2.7/dist-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /usr/local/lib/python2.7/dist-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5079149986490919360.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: grpcio<2,>=1.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.3-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python2.7/dist-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: hdfs, pytz, nose, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam hdfs-2.1.0 nose-1.3.7 pytz-2018.3
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7922398525187958772.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-09 12:00:33,138 cfa32567 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cfa32567/pkb.log>
2018-04-09 12:00:33,138 cfa32567 MainThread INFO PerfKitBenchmarker version: v1.12.0-468-gd19e6df
2018-04-09 12:00:33,138 cfa32567 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-09 12:00:33,481 cfa32567 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-09 12:00:33,481 cfa32567 MainThread INFO Initializing the edw service decoder
2018-04-09 12:00:33,609 cfa32567 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-09 12:00:33,612 cfa32567 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-09 12:00:33,612 cfa32567 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-09 12:00:41,280 cfa32567 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-09 12:08:44,761 cfa32567 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-09 12:08:44,782 cfa32567 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cfa32567/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-09 12:08:45,278 cfa32567 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cfa32567/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-09 12:08:45,278 cfa32567 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-09 12:08:45,350 cfa32567 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-09 12:08:45,352 cfa32567 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 758, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-09 12:08:45,352 cfa32567 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-09 12:08:45,366 cfa32567 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-09 12:08:45,367 cfa32567 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cfa32567/pkb.log>
2018-04-09 12:08:45,367 cfa32567 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cfa32567/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1168
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1168/display/redirect?page=changes>
Changes:
[swegner] Upgrade to latest Gradle
[tgroh] Rename RootProviderRegistry#default to #javaNative
[tgroh] Add an `impulseRegistry` that only supports Impulse
[swegner] Update build command in pull request template
[swegner] Remove maven helper from jenkins job utils
[swegner] Remove unused test_wordcount script
[swegner] Update Gearpump docs for gradle, and add TODO
[swegner] Update Go build doc to reflect Gradle build system
[aaltay] [BEAM-4122] Tune Gradle resource usage on Jenkins (#5171)
------------------------------------------
[...truncated 64.62 KB...]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get -u google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/subscription.go:30:2: cannot find package "golang.org/x/sync/errgroup" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/errgroup (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/errgroup (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/beam/sdks/go/target/src/golang.org/x/sync/errgroup>
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/flow_controller.go:19:2: cannot find package "golang.org/x/sync/semaphore" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/semaphore (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/semaphore (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/beam/sdks/go/target/src/golang.org/x/sync/semaphore>
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 2.860 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 2.277 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.045 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 6.452 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 3.196 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 3.927 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.168 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 19.238 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 40.130 s
[INFO] Finished at: 2018-04-19T18:23:56Z
[INFO] Final Memory: 81M/976M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.7:test (go-test) on project beam-sdks-go: Process exit code : 1 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-19 18:23:57,375 ac029cc0 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-19 18:23:57,382 ac029cc0 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/beam/sdks/python/target>
2018-04-19 18:23:57,384 ac029cc0 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-19 18:23:57,386 ac029cc0 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/beam/sdks/python/target>
2018-04-19 18:23:57,386 ac029cc0 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-19 18:23:57,427 ac029cc0 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-19 18:23:57,427 ac029cc0 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/pkb.log>
2018-04-19 18:23:57,427 ac029cc0 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/ac029cc0/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user boyuanz@google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1167
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1167/display/redirect>
------------------------------------------
[...truncated 67.65 KB...]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get -u google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/subscription.go:30:2: cannot find package "golang.org/x/sync/errgroup" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/errgroup (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/errgroup (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/beam/sdks/go/target/src/golang.org/x/sync/errgroup>
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/flow_controller.go:19:2: cannot find package "golang.org/x/sync/semaphore" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/semaphore (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/semaphore (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/beam/sdks/go/target/src/golang.org/x/sync/semaphore>
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 16.516 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 9.241 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.093 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 17.638 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 6.532 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 8.073 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.339 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 42.365 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:50 min
[INFO] Finished at: 2018-04-19T12:03:09Z
[INFO] Final Memory: 91M/1403M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.7:test (go-test) on project beam-sdks-go: Process exit code : 1 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-19 12:03:10,231 04236ab4 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-19 12:03:10,239 04236ab4 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/beam/sdks/python/target>
2018-04-19 12:03:10,240 04236ab4 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-19 12:03:10,242 04236ab4 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/beam/sdks/python/target>
2018-04-19 12:03:10,242 04236ab4 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-19 12:03:10,255 04236ab4 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-19 12:03:10,255 04236ab4 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/pkb.log>
2018-04-19 12:03:10,255 04236ab4 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04236ab4/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user boyuanz@google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1166
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1166/display/redirect>
------------------------------------------
[...truncated 61.93 KB...]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get -u google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/subscription.go:30:2: cannot find package "golang.org/x/sync/errgroup" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/errgroup (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/errgroup (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/beam/sdks/go/target/src/golang.org/x/sync/errgroup>
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/flow_controller.go:19:2: cannot find package "golang.org/x/sync/semaphore" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/semaphore (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/semaphore (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/beam/sdks/go/target/src/golang.org/x/sync/semaphore>
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 9.847 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 7.156 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.183 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 23.898 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 10.437 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 11.047 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.455 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 55.575 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:03 min
[INFO] Finished at: 2018-04-19T06:03:15Z
[INFO] Final Memory: 86M/1264M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.7:test (go-test) on project beam-sdks-go: Process exit code : 1 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-19 06:03:15,773 6efa90da MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-19 06:03:15,785 6efa90da MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/beam/sdks/python/target>
2018-04-19 06:03:15,787 6efa90da MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-19 06:03:15,790 6efa90da MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/beam/sdks/python/target>
2018-04-19 06:03:15,790 6efa90da MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-19 06:03:15,852 6efa90da MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-19 06:03:15,852 6efa90da MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/pkb.log>
2018-04-19 06:03:15,853 6efa90da MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/6efa90da/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1165
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1165/display/redirect?page=changes>
Changes:
[coheigea] Change equals() + toUpper/LowerCase to equalsIgnoreCase
[yifanzou] BEAM-3339 Mobile gaming automation for Java nightly snapshot
[sidhom] [BEAM-4069] Gracefully deserialize empty options structs
[iemejia] [BEAM-4019] Refactor HBaseIO splitting to produce ByteKeyRange objects
[ehudm] Fix localfilesystem _list() operation.
[aaltay] [BEAM-4108] Generate javadocs for release (#5121)
------------------------------------------
[...truncated 30.63 KB...]
[INFO] --- maven-compiler-plugin:3.7.0:testCompile (default-testCompile) @ beam-sdks-java-build-tools ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 1 source file to <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/java/build-tools/target/test-classes>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-java-build-tools ---
[INFO]
[INFO] --- maven-surefire-plugin:2.21.0:test (default-test) @ beam-sdks-java-build-tools ---
[INFO] Tests are skipped.
[INFO]
[INFO] --- build-helper-maven-plugin:3.0.0:regex-properties (render-artifact-id) @ beam-sdks-java-build-tools ---
[INFO]
[INFO] --- maven-jar-plugin:3.0.2:jar (default-jar) @ beam-sdks-java-build-tools ---
[INFO] Building jar: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/java/build-tools/target/beam-sdks-java-build-tools-2.5.0-SNAPSHOT.jar>
[INFO]
[INFO] --- maven-site-plugin:3.7:attach-descriptor (attach-descriptor) @ beam-sdks-java-build-tools ---
[INFO] Skipping because packaging 'jar' is not pom.
[INFO]
[INFO] --- maven-jar-plugin:3.0.2:test-jar (default-test-jar) @ beam-sdks-java-build-tools ---
[INFO] Building jar: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/java/build-tools/target/beam-sdks-java-build-tools-2.5.0-SNAPSHOT-tests.jar>
[INFO]
[INFO] --- maven-shade-plugin:3.1.0:shade (bundle-and-repackage) @ beam-sdks-java-build-tools ---
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/java/build-tools/target/beam-sdks-java-build-tools-2.5.0-SNAPSHOT.jar> with <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/java/build-tools/target/beam-sdks-java-build-tools-2.5.0-SNAPSHOT-shaded.jar>
[INFO] Replacing original test artifact with shaded test artifact.
[INFO] Replacing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/java/build-tools/target/beam-sdks-java-build-tools-2.5.0-SNAPSHOT-tests.jar> with <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/java/build-tools/target/beam-sdks-java-build-tools-2.5.0-SNAPSHOT-shaded-tests.jar>
[INFO]
[INFO] --- maven-dependency-plugin:3.0.2:analyze-only (default) @ beam-sdks-java-build-tools ---
[INFO] No dependency problems found
[INFO]
[INFO] --- maven-install-plugin:2.5.2:install (default-install) @ beam-sdks-java-build-tools ---
[INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/java/build-tools/target/beam-sdks-java-build-tools-2.5.0-SNAPSHOT.jar> to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-build-tools/2.5.0-SNAPSHOT/beam-sdks-java-build-tools-2.5.0-SNAPSHOT.jar
[INFO] Installing <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/java/build-tools/pom.xml> to /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-build-tools/2.5.0-SNAPSHOT/beam-sdks-java-build-tools-2.5.0-SNAPSHOT.pom
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 6.570 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... FAILURE [ 3.882 s]
[INFO] Apache Beam :: Model ............................... SKIPPED
[INFO] Apache Beam :: Model :: Pipeline ................... SKIPPED
[INFO] Apache Beam :: Model :: Job Management ............. SKIPPED
[INFO] Apache Beam :: Model :: Fn Execution ............... SKIPPED
[INFO] Apache Beam :: SDKs ................................ SKIPPED
[INFO] Apache Beam :: SDKs :: Go .......................... SKIPPED
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 14.473 s
[INFO] Finished at: 2018-04-19T01:21:31Z
[INFO] Final Memory: 68M/703M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-install-plugin:2.5.2:install (default-install) on project beam-sdks-java-build-tools: Failed to install metadata org.apache.beam:beam-sdks-java-build-tools:2.5.0-SNAPSHOT/maven-metadata.xml: Could not parse metadata /home/jenkins/.m2/repository/org/apache/beam/beam-sdks-java-build-tools/2.5.0-SNAPSHOT/maven-metadata-local.xml: in epilog non whitespace content is not allowed but got n (position: END_TAG seen ...</metadata>\nn... @21:2) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-java-build-tools
STDERR:
2018-04-19 01:21:32,112 e64a91b4 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-19 01:21:32,131 e64a91b4 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/python/target>
2018-04-19 01:21:32,132 e64a91b4 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-19 01:21:32,134 e64a91b4 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/beam/sdks/python/target>
2018-04-19 01:21:32,134 e64a91b4 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-19 01:21:32,154 e64a91b4 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-19 01:21:32,155 e64a91b4 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/pkb.log>
2018-04-19 01:21:32,155 e64a91b4 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e64a91b4/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1164
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1164/display/redirect>
------------------------------------------
[...truncated 61.88 KB...]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get -u google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/subscription.go:30:2: cannot find package "golang.org/x/sync/errgroup" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/errgroup (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/errgroup (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/beam/sdks/go/target/src/golang.org/x/sync/errgroup>
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/flow_controller.go:19:2: cannot find package "golang.org/x/sync/semaphore" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/semaphore (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/semaphore (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/beam/sdks/go/target/src/golang.org/x/sync/semaphore>
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 3.157 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 2.252 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.041 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 9.223 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 5.193 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 6.958 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.244 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 22.217 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 51.513 s
[INFO] Finished at: 2018-04-18T18:02:06Z
[INFO] Final Memory: 81M/1006M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.7:test (go-test) on project beam-sdks-go: Process exit code : 1 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-18 18:02:07,170 3f4c780c MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-18 18:02:07,183 3f4c780c MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/beam/sdks/python/target>
2018-04-18 18:02:07,184 3f4c780c MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-18 18:02:07,186 3f4c780c MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/beam/sdks/python/target>
2018-04-18 18:02:07,186 3f4c780c MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-18 18:02:07,225 3f4c780c MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-18 18:02:07,226 3f4c780c MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/pkb.log>
2018-04-18 18:02:07,226 3f4c780c MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3f4c780c/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1163
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1163/display/redirect?page=changes>
Changes:
[github] Remove a call to pip.pep425tags() which is not available in pip 10.
[github] Remove unused import.
------------------------------------------
[...truncated 63.53 KB...]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get -u google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/subscription.go:30:2: cannot find package "golang.org/x/sync/errgroup" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/errgroup (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/errgroup (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/beam/sdks/go/target/src/golang.org/x/sync/errgroup>
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/flow_controller.go:19:2: cannot find package "golang.org/x/sync/semaphore" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/semaphore (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/semaphore (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/beam/sdks/go/target/src/golang.org/x/sync/semaphore>
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 3.390 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 3.609 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.091 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 13.803 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 5.933 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 7.110 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.344 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 59.820 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:37 min
[INFO] Finished at: 2018-04-18T12:02:50Z
[INFO] Final Memory: 85M/1171M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.7:test (go-test) on project beam-sdks-go: Process exit code : 1 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-18 12:02:51,574 75ce6ca4 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-18 12:02:51,579 75ce6ca4 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/beam/sdks/python/target>
2018-04-18 12:02:51,580 75ce6ca4 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-18 12:02:51,582 75ce6ca4 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/beam/sdks/python/target>
2018-04-18 12:02:51,582 75ce6ca4 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-18 12:02:51,621 75ce6ca4 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-18 12:02:51,622 75ce6ca4 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/pkb.log>
2018-04-18 12:02:51,622 75ce6ca4 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/75ce6ca4/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1162
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1162/display/redirect?page=changes>
Changes:
[aaltay] Support staging binary distributions (wheel files) of Beam SDK. (#5110)
------------------------------------------
[...truncated 63.57 KB...]
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/882cfdc2/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get -u google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] # cd /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/oauth2; git pull --ff-only
[ERROR] fatal: Unable to create '/home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/oauth2/.git/ORIG_HEAD.lock': File exists.
[ERROR]
[ERROR] If no other git process is currently running, this probably means a
[ERROR] git process crashed in this repository earlier. Make sure no other git
[ERROR] process is running and remove the file manually to continue.
[ERROR] package golang.org/x/oauth2/google: exit status 128
[ERROR] # cd /home/jenkins/.mvnGoLang/.go_path/src/github.com/googleapis/gax-go; git pull --ff-only
[ERROR] fatal: Unable to create '/home/jenkins/.mvnGoLang/.go_path/src/github.com/googleapis/gax-go/.git/ORIG_HEAD.lock': File exists.
[ERROR]
[ERROR] If no other git process is currently running, this probably means a
[ERROR] git process crashed in this repository earlier. Make sure no other git
[ERROR] process is running and remove the file manually to continue.
[ERROR] package github.com/googleapis/gax-go: exit status 128
[ERROR] # cd /home/jenkins/.mvnGoLang/.go_path/src/go.opencensus.io; git pull --ff-only
[ERROR] fatal: Unable to create '/home/jenkins/.mvnGoLang/.go_path/src/go.opencensus.io/.git/refs/remotes/origin/master.lock': File exists.
[ERROR]
[ERROR] If no other git process is currently running, this probably means a
[ERROR] git process crashed in this repository earlier. Make sure no other git
[ERROR] process is running and remove the file manually to continue.
[ERROR] Unexpected end of command stream
[ERROR] package go.opencensus.io/trace: exit status 1
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 3.775 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 4.518 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.136 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 14.066 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 6.344 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 7.001 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.257 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 30.369 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:10 min
[INFO] Finished at: 2018-04-18T06:02:14Z
[INFO] Final Memory: 84M/1039M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.7:get (go-get-imports) on project beam-sdks-go: Process exit code : 1 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-18 06:02:14,744 882cfdc2 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-18 06:02:14,750 882cfdc2 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/882cfdc2/beam/sdks/python/target>
2018-04-18 06:02:14,751 882cfdc2 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-18 06:02:14,752 882cfdc2 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/882cfdc2/beam/sdks/python/target>
2018-04-18 06:02:14,752 882cfdc2 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-18 06:02:14,815 882cfdc2 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-18 06:02:14,815 882cfdc2 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/882cfdc2/pkb.log>
2018-04-18 06:02:14,816 882cfdc2 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/882cfdc2/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1161
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1161/display/redirect?page=changes>
Changes:
[herohde] Add prototype of Go streaming on Dataflow with PubSub
[ekirpichov] Fixes run_pylint to run on Mac
[lukasz.gajowy] [BEAM-3942] Add Tasks for running IOITs manually using gradle
[lukasz.gajowy] [BEAM-3942] Add task for running integration tests with
[lukasz.gajowy] [BEAM-4099] Rebuild project before running Performance tests on Jenkins
[Pablo] Restricting hosts where Python PreCommit runs due to environmental
[alan.myrvold] Fix spark validates runner test by skipping ImpulseTest
[Pablo] Fix in gen_protos
[aaltay] Fix flaky Python local filesystem test (#5156)
------------------------------------------
[...truncated 62.77 KB...]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get -u google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.7:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/subscription.go:30:2: cannot find package "golang.org/x/sync/errgroup" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/errgroup (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/errgroup (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/beam/sdks/go/target/src/golang.org/x/sync/errgroup>
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/cloud.google.com/go/pubsub/flow_controller.go:19:2: cannot find package "golang.org/x/sync/semaphore" in any of:
[ERROR] /home/jenkins/.mvnGoLang/go1.9.linux-amd64/src/golang.org/x/sync/semaphore (from $GOROOT)
[ERROR] /home/jenkins/.mvnGoLang/.go_path/src/golang.org/x/sync/semaphore (from $GOPATH)
[ERROR] <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/beam/sdks/go/target/src/golang.org/x/sync/semaphore>
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 3.595 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 3.677 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.153 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 10.837 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 3.760 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 4.667 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.154 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 43.232 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:12 min
[INFO] Finished at: 2018-04-18T00:19:04Z
[INFO] Final Memory: 83M/1080M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.7:test (go-test) on project beam-sdks-go: Process exit code : 1 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-18 00:19:04,539 644cdaad MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-18 00:19:04,547 644cdaad MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/beam/sdks/python/target>
2018-04-18 00:19:04,548 644cdaad MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-18 00:19:04,550 644cdaad MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/beam/sdks/python/target>
2018-04-18 00:19:04,550 644cdaad MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-18 00:19:04,599 644cdaad MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-18 00:19:04,600 644cdaad MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/pkb.log>
2018-04-18 00:19:04,600 644cdaad MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/644cdaad/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1160
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1160/display/redirect?page=changes>
Changes:
[swegner] Exclude UsesImpluse from Apex postcommit tests
[swegner] Exclude UsesImpluse from Spark postcommit tests
[swegner] Increase Dataflow max parallelism.
[axelmagn] Rename EnvironmentManager to EnvironmentFactory
[alan.myrvold] Fix faling spark quickstart
[swegner] fixup! Improve comment
------------------------------------------
[...truncated 633.35 KB...]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.793 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.853 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 2.295 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 3.477 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.675 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 2.176 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 5.861 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 10.058 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.320 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 4.181 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 4.094 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 3.405 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 15.803 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 6.972 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 10.356 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 2.650 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.983 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 2.205 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 3.454 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 2.482 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 2.375 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 5.879 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 4.727 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.100 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 11.171 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.178 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 4.052 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 34.676 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.797 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.900 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 2.686 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.592 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 19.207 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 18.057 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 10.461 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 07:01 min
[INFO] Finished at: 2018-04-17T18:35:07Z
[INFO] Final Memory: 375M/1638M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3b5199fd/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3b5199fd/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3b5199fd/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3b5199fd/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3b5199fd/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-17 18:35:09,143 3b5199fd MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-17 18:35:09,157 3b5199fd MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-17 18:35:09,158 3b5199fd MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-17 18:35:09,161 3b5199fd MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-17 18:35:09,161 3b5199fd MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-17 18:35:09,207 3b5199fd MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-17 18:35:09,208 3b5199fd MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3b5199fd/pkb.log>
2018-04-17 18:35:09,209 3b5199fd MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/3b5199fd/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1159
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1159/display/redirect>
------------------------------------------
[...truncated 631.95 KB...]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 2.756 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 2.567 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 1.022 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.614 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 3.438 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 4.832 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.557 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.959 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 4.907 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 8.606 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.181 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 7.737 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 4.440 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 3.945 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 24.306 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 8.693 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 13.848 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 2.416 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.895 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 2.497 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 3.270 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 2.548 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.978 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 7.226 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 7.935 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.060 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 9.520 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.086 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 3.188 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 34.845 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 4.556 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.789 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 3.233 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 6.635 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 22.160 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 21.052 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 20.624 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 09:05 min
[INFO] Finished at: 2018-04-17T12:10:07Z
[INFO] Final Memory: 404M/1900M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753063a0/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753063a0/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753063a0/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753063a0/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753063a0/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-17 12:10:09,080 753063a0 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-17 12:10:09,090 753063a0 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-17 12:10:09,163 753063a0 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-17 12:10:09,165 753063a0 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-17 12:10:09,165 753063a0 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-17 12:10:09,205 753063a0 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-17 12:10:09,206 753063a0 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753063a0/pkb.log>
2018-04-17 12:10:09,206 753063a0 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753063a0/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1158
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1158/display/redirect?page=changes>
Changes:
[apilloud] [SQL] Remove PRIMARY KEY it does nothing
[apilloud] [SQL] Plumb through column nullable field
[apilloud] [SQL] Copy in DDL code from Calicite 1.16
[apilloud] [SQL] Patch ddl code for beam
[ehudm] Normalize Filesystems.match() glob behavior.
[amyrvold] Fix failing nightly release build
------------------------------------------
[...truncated 633.04 KB...]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.571 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.785 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 1.668 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 2.822 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.165 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.787 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 5.388 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 9.102 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.092 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 3.528 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 2.931 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 2.950 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 9.891 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 5.390 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 9.051 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 1.883 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.318 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 1.637 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.756 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 1.988 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.786 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 4.431 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 3.054 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.053 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 7.595 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.046 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 3.187 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 28.361 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.435 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.544 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 2.150 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.201 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 14.778 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 17.825 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 13.818 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:59 min
[INFO] Finished at: 2018-04-17T06:06:56Z
[INFO] Final Memory: 347M/1970M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/baf27461/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/baf27461/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/baf27461/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/baf27461/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/baf27461/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-17 06:06:59,655 baf27461 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-17 06:06:59,683 baf27461 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-17 06:06:59,695 baf27461 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-17 06:06:59,698 baf27461 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 778, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 644, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-17 06:06:59,698 baf27461 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-17 06:06:59,761 baf27461 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-17 06:06:59,761 baf27461 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/baf27461/pkb.log>
2018-04-17 06:06:59,761 baf27461 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/baf27461/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1157
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1157/display/redirect?page=changes>
Changes:
[swegner] Fix a typo in gradle task group
[mingmxu] support MAP in SQL schema
[mingmxu] in MAP, key as primitive, and value can be primitive/array/map/row
[mingmxu] use Collection for ARRAY type, and re-org `verify` code in `Row`
[mingmxu] rebase as file conflict with #5089
[github] Update containers at master to newly released beam-master-20180413.
[mingmxu] rename CollectionType to CollectionElementType
[github] Add region to dataflowOptions struct.
[sidhom] [BEAM-4056] Identify side inputs by transform id and local name
[sidhom] Add side input assertions to ExecutableStageMatcher
------------------------------------------
[...truncated 633.16 KB...]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.843 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.599 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 2.567 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 4.310 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.260 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.963 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 5.559 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 9.089 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.452 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 4.017 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 3.636 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 4.123 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 14.388 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 6.751 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 9.639 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 2.102 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.476 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 2.042 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.745 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 2.142 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.957 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 5.055 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 4.904 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.062 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 8.377 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.165 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 3.289 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 31.063 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.458 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.746 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 2.510 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.208 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 16.797 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 15.173 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 11.287 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 07:00 min
[INFO] Finished at: 2018-04-17T00:13:59Z
[INFO] Final Memory: 339M/2155M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/79e27f30/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/79e27f30/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/79e27f30/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/79e27f30/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/79e27f30/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-17 00:14:00,672 79e27f30 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-17 00:14:00,683 79e27f30 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-17 00:14:00,684 79e27f30 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-17 00:14:00,686 79e27f30 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-17 00:14:00,686 79e27f30 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-17 00:14:00,708 79e27f30 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-17 00:14:00,708 79e27f30 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/79e27f30/pkb.log>
2018-04-17 00:14:00,708 79e27f30 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/79e27f30/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1156
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1156/display/redirect?page=changes>
Changes:
[tgroh] Update Dataflow Development Container Version
[github] Add region to dataflowOptions as well.
[tgroh] Use Explicit PipelineOptions in Native Evaluators
------------------------------------------
[...truncated 71.67 KB...]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec 0.038s
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/optimized [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/core/runtime/graphx 0.045s
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/core/runtime/graphx/v1 [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/init [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/session [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/core/typex 0.025s
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/core/util/dot [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/core/util/hooks [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/core/util/ioutilx [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/core/util/protox 0.042s
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/core/util/reflectx [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/core/util/symtab [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/io/bigqueryio 0.052s
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/io/textio [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/io/textio/gcs [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/io/textio/local [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/log [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/model [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/model/fnexecution_v1 [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/model/jobmanagement_v1 [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/model/pipeline_v1 [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/options/gcpopts [no test files]
[INFO] ? github.com/apache/beam/sdks/go/pkg/beam/options/jobopts [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/provision 0.059s
[INFO]
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/runners/dataflow
[ERROR] github.com/apache/beam/sdks/go/pkg/beam/runners/dataflow/dataflow.go:171:12: unknown field 'Region' in struct literal of type dataflowOptions
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 8.932 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 8.486 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.198 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 24.023 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 11.817 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 14.075 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.383 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [02:21 min]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 03:35 min
[INFO] Finished at: 2018-04-16T18:05:04Z
[INFO] Final Memory: 90M/1406M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.7:test (go-test) on project beam-sdks-go: Process exit code : 2 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-16 18:05:06,052 4c502881 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-16 18:05:06,082 4c502881 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/4c502881/beam/sdks/python/target>
2018-04-16 18:05:06,083 4c502881 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-16 18:05:06,086 4c502881 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/4c502881/beam/sdks/python/target>
2018-04-16 18:05:06,087 4c502881 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-16 18:05:06,131 4c502881 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-16 18:05:06,132 4c502881 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/4c502881/pkb.log>
2018-04-16 18:05:06,132 4c502881 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/4c502881/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1155
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1155/display/redirect>
------------------------------------------
[...truncated 627.11 KB...]
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 3.251 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.045 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 3.611 s]
[INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.067 s]
[INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 3.991 s]
[INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 4.274 s]
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 6.733 s]
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 9.042 s]
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.093 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 2.817 s]
[INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 1.267 s]
[INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 8.819 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 2.444 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 1.671 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 2.278 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 1.936 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.851 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.675 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 2.148 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 2.513 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 3.008 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.695 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 4.923 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 8.662 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.047 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 4.018 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 2.854 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 3.313 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 17.108 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 5.582 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 9.408 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 2.000 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.366 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 2.224 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.713 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 2.055 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.708 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 4.601 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 3.420 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.054 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 6.341 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.047 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 2.949 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 26.420 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.392 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.488 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 1.983 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.216 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 14.444 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 14.548 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 10.332 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:29 min
[INFO] Finished at: 2018-04-16T12:07:20Z
[INFO] Final Memory: 335M/2003M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/80b8b3e6/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/80b8b3e6/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/80b8b3e6/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/80b8b3e6/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/80b8b3e6/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-16 12:07:21,888 80b8b3e6 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-16 12:07:21,898 80b8b3e6 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-16 12:07:21,899 80b8b3e6 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-16 12:07:21,901 80b8b3e6 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-16 12:07:21,901 80b8b3e6 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-16 12:07:21,926 80b8b3e6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-16 12:07:21,927 80b8b3e6 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/80b8b3e6/pkb.log>
2018-04-16 12:07:21,927 80b8b3e6 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/80b8b3e6/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1154
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1154/display/redirect>
------------------------------------------
[...truncated 627.51 KB...]
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 2.449 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.066 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 3.234 s]
[INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.087 s]
[INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 4.577 s]
[INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 4.220 s]
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 6.237 s]
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 9.692 s]
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.041 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 2.087 s]
[INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 1.197 s]
[INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 8.534 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 1.997 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 1.484 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 2.365 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 1.670 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.488 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.548 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 1.668 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 1.966 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 1.992 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.736 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 5.003 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 8.438 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.021 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 3.074 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 2.887 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 3.227 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 9.553 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 5.002 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 7.175 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 1.801 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.140 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 1.423 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.638 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 1.760 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.748 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 3.908 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 2.727 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.018 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 6.237 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.030 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 2.982 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 25.839 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.371 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.463 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 1.940 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.041 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 12.483 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 14.913 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 6.003 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:20 min
[INFO] Finished at: 2018-04-16T06:06:01Z
[INFO] Final Memory: 336M/1827M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8228cfda/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8228cfda/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8228cfda/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8228cfda/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8228cfda/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-16 06:06:03,015 8228cfda MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-16 06:06:03,025 8228cfda MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-16 06:06:03,026 8228cfda MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-16 06:06:03,027 8228cfda MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-16 06:06:03,027 8228cfda MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-16 06:06:03,075 8228cfda MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-16 06:06:03,076 8228cfda MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8228cfda/pkb.log>
2018-04-16 06:06:03,076 8228cfda MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8228cfda/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1153
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1153/display/redirect>
------------------------------------------
[...truncated 628.68 KB...]
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 3.002 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.046 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 3.242 s]
[INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.044 s]
[INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 4.656 s]
[INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 4.562 s]
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 6.542 s]
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 11.803 s]
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.046 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 2.546 s]
[INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 1.192 s]
[INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 8.756 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 2.884 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 1.611 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 2.883 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 1.837 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.818 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.637 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 3.159 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 4.793 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.164 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.656 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 4.909 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 8.778 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.135 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 4.322 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 2.851 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 2.757 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 15.808 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 5.954 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 8.618 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 1.916 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.159 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 1.879 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.625 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 2.310 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 2.029 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 4.477 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 3.328 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.058 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 7.712 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.092 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 2.963 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 27.734 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.396 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.517 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 2.355 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.116 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 16.017 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 14.516 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 9.277 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:18 min
[INFO] Finished at: 2018-04-16T00:07:07Z
[INFO] Final Memory: 339M/1889M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bf509d3e/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bf509d3e/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bf509d3e/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bf509d3e/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bf509d3e/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-16 00:07:08,354 bf509d3e MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-16 00:07:08,364 bf509d3e MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-16 00:07:08,365 bf509d3e MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-16 00:07:08,367 bf509d3e MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-16 00:07:08,367 bf509d3e MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-16 00:07:08,409 bf509d3e MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-16 00:07:08,409 bf509d3e MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bf509d3e/pkb.log>
2018-04-16 00:07:08,410 bf509d3e MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bf509d3e/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1152
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1152/display/redirect>
------------------------------------------
[...truncated 627.22 KB...]
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 2.996 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.063 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 2.895 s]
[INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.062 s]
[INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 4.119 s]
[INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 4.138 s]
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 5.943 s]
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 8.414 s]
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.038 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 2.538 s]
[INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 1.210 s]
[INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 8.609 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 2.517 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 1.634 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 2.107 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 1.823 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.543 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.567 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 1.918 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 2.031 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.125 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.621 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 4.837 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 8.425 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.562 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 3.659 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 3.785 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 3.388 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 10.734 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 7.822 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 12.349 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 1.997 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.085 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 2.258 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 3.199 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 2.001 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.899 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 6.309 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 6.268 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.019 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 6.165 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.032 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 2.971 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 26.166 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.331 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.472 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 1.936 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.048 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 12.915 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 16.189 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 6.011 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:26 min
[INFO] Finished at: 2018-04-15T18:06:25Z
[INFO] Final Memory: 331M/1820M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04f87b0f/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04f87b0f/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04f87b0f/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04f87b0f/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04f87b0f/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-15 18:06:26,115 04f87b0f MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-15 18:06:26,125 04f87b0f MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-15 18:06:26,127 04f87b0f MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-15 18:06:26,129 04f87b0f MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-15 18:06:26,129 04f87b0f MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-15 18:06:26,152 04f87b0f MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-15 18:06:26,153 04f87b0f MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04f87b0f/pkb.log>
2018-04-15 18:06:26,153 04f87b0f MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/04f87b0f/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1151
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1151/display/redirect>
------------------------------------------
[...truncated 627.27 KB...]
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 2.901 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.053 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 3.153 s]
[INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.067 s]
[INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 4.295 s]
[INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 4.771 s]
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 6.302 s]
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 8.331 s]
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.065 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 2.325 s]
[INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 1.274 s]
[INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 9.065 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 2.672 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 1.458 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 2.251 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 2.075 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.507 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.556 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 1.585 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 2.460 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.027 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.655 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 4.972 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 8.774 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 1.984 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 3.366 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 3.372 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 3.376 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 10.128 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 5.309 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 7.362 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 1.901 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.272 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 1.559 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.698 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 1.810 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.646 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 4.053 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 2.702 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.016 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 6.199 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.029 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 3.013 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 27.737 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.921 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.612 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 1.934 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 3.741 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 13.452 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 16.568 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 10.909 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:41 min
[INFO] Finished at: 2018-04-15T12:06:30Z
[INFO] Final Memory: 369M/1925M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f162e2db/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f162e2db/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f162e2db/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f162e2db/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f162e2db/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-15 12:06:31,598 f162e2db MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-15 12:06:31,613 f162e2db MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-15 12:06:31,614 f162e2db MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-15 12:06:31,615 f162e2db MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-15 12:06:31,615 f162e2db MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-15 12:06:31,654 f162e2db MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-15 12:06:31,655 f162e2db MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f162e2db/pkb.log>
2018-04-15 12:06:31,655 f162e2db MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f162e2db/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1150
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1150/display/redirect>
------------------------------------------
[...truncated 627.28 KB...]
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 3.112 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.065 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 3.077 s]
[INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.053 s]
[INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 3.813 s]
[INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 3.797 s]
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 6.260 s]
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 8.148 s]
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.049 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 2.859 s]
[INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 1.354 s]
[INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 8.962 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 2.409 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 1.536 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 2.781 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 2.029 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.846 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.576 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 3.107 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 3.697 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.119 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.769 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 5.608 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 8.765 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.118 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 4.347 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 3.518 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 3.171 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 17.375 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 5.107 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 7.703 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 1.888 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.205 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 1.765 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.512 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 1.987 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.656 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 4.763 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 3.263 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.021 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 7.172 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.053 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 3.221 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 25.972 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.604 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.418 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 2.425 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.014 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 14.667 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 14.129 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 8.942 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:04 min
[INFO] Finished at: 2018-04-15T06:06:52Z
[INFO] Final Memory: 408M/1558M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/344a2725/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/344a2725/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/344a2725/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/344a2725/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/344a2725/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-15 06:06:54,396 344a2725 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-15 06:06:54,406 344a2725 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-15 06:06:54,407 344a2725 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-15 06:06:54,408 344a2725 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-15 06:06:54,408 344a2725 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-15 06:06:54,441 344a2725 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-15 06:06:54,441 344a2725 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/344a2725/pkb.log>
2018-04-15 06:06:54,441 344a2725 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/344a2725/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1149
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1149/display/redirect>
------------------------------------------
[...truncated 628.64 KB...]
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 2.995 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.045 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 2.988 s]
[INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.103 s]
[INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 4.298 s]
[INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 3.620 s]
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 6.027 s]
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 19.224 s]
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.084 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 2.685 s]
[INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 1.158 s]
[INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 9.218 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 2.192 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 1.430 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 2.340 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 1.789 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.792 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.574 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 1.918 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 2.315 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.125 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.751 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 4.989 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 8.643 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.145 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 4.318 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 2.969 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 2.815 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 15.565 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 5.208 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 9.640 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 1.989 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.221 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 1.617 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.668 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 2.107 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.674 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 4.592 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 3.207 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.021 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 5.921 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.040 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 3.094 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 25.728 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.474 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.484 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 1.955 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.021 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 14.918 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 14.452 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 8.667 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 05:59 min
[INFO] Finished at: 2018-04-15T00:07:11Z
[INFO] Final Memory: 343M/1948M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753bcd09/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753bcd09/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753bcd09/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753bcd09/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753bcd09/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-15 00:07:12,629 753bcd09 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-15 00:07:12,638 753bcd09 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-15 00:07:12,639 753bcd09 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-15 00:07:12,641 753bcd09 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-15 00:07:12,641 753bcd09 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-15 00:07:12,681 753bcd09 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-15 00:07:12,682 753bcd09 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753bcd09/pkb.log>
2018-04-15 00:07:12,682 753bcd09 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/753bcd09/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Build failed in Jenkins: beam_PerformanceTests_Python #1148
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1148/display/redirect>
------------------------------------------
[...truncated 631.65 KB...]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.809 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.596 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 2.093 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 2.568 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.098 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.650 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 5.301 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 8.233 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.571 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 4.555 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 3.526 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 2.994 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 16.275 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 5.859 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 8.059 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 1.940 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.319 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 1.650 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.503 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 1.894 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.659 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 4.334 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 3.393 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.032 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 8.028 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.055 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 3.042 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 26.870 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.460 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.452 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 2.445 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.031 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 14.885 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 15.265 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 11.476 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:25 min
[INFO] Finished at: 2018-04-14T18:07:32Z
[INFO] Final Memory: 338M/1854M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/11512ea3/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/11512ea3/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/11512ea3/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/11512ea3/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/11512ea3/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-14 18:07:33,461 11512ea3 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-14 18:07:33,473 11512ea3 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-14 18:07:33,475 11512ea3 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-14 18:07:33,476 11512ea3 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-14 18:07:33,477 11512ea3 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-14 18:07:33,501 11512ea3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-14 18:07:33,502 11512ea3 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/11512ea3/pkb.log>
2018-04-14 18:07:33,502 11512ea3 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/11512ea3/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1147
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1147/display/redirect>
------------------------------------------
[...truncated 627.91 KB...]
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SUCCESS [ 2.850 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SUCCESS [ 0.041 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SUCCESS [ 2.893 s]
[INFO] Apache Beam :: Runners ............................. SUCCESS [ 0.130 s]
[INFO] Apache Beam :: Runners :: Core Construction Java ... SUCCESS [ 3.945 s]
[INFO] Apache Beam :: Runners :: Core Java ................ SUCCESS [ 3.868 s]
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SUCCESS [ 6.062 s]
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SUCCESS [ 12.841 s]
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SUCCESS [ 0.040 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SUCCESS [ 2.687 s]
[INFO] Apache Beam :: Runners :: Local Java Core .......... SUCCESS [ 1.523 s]
[INFO] Apache Beam :: Runners :: Direct Java .............. SUCCESS [ 8.866 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SUCCESS [ 2.782 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SUCCESS [ 1.662 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SUCCESS [ 2.676 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SUCCESS [ 1.693 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SUCCESS [ 0.824 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SUCCESS [ 0.578 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SUCCESS [ 2.922 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SUCCESS [ 4.331 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SUCCESS [ 2.216 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SUCCESS [ 1.722 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SUCCESS [ 4.861 s]
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SUCCESS [ 7.786 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SUCCESS [ 2.072 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SUCCESS [ 4.850 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SUCCESS [ 3.650 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SUCCESS [ 4.184 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SUCCESS [ 19.053 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SUCCESS [ 7.898 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SUCCESS [ 12.325 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SUCCESS [ 1.974 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SUCCESS [ 2.586 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SUCCESS [ 2.436 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SUCCESS [ 2.747 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SUCCESS [ 2.122 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SUCCESS [ 1.764 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SUCCESS [ 4.531 s]
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SUCCESS [ 3.524 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SUCCESS [ 0.051 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SUCCESS [ 8.236 s]
[INFO] Apache Beam :: Examples ............................ SUCCESS [ 0.076 s]
[INFO] Apache Beam :: Examples :: Java .................... SUCCESS [ 2.944 s]
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SUCCESS [ 26.567 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SUCCESS [ 1.449 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SUCCESS [ 1.501 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SUCCESS [ 2.511 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SUCCESS [ 2.146 s]
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SUCCESS [ 16.100 s]
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SUCCESS [ 14.826 s]
[INFO] Apache Beam :: SDKs :: Python ...................... FAILURE [ 9.194 s]
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:43 min
[INFO] Finished at: 2018-04-14T12:42:32Z
[INFO] Final Memory: 342M/1955M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.5.0:exec (setuptools-build) on project beam-sdks-python: Command execution failed.: Process exited with an error: 1 (Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-python
STDERR: log4j:WARN No appenders could be found for logger (freemarker.cache).
log4j:WARN Please initialize the log4j system properly.
Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
/usr/local/lib/python2.7/dist-packages/pip/_vendor/urllib3/util/ssl_.py:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
cheetah 2.4.4 requires Markdown>=2.0.1, which is not installed.
/usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/54712b50/beam/sdks/python/gen_protos.py>:51: UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/54712b50/beam/sdks/python/.eggs/grpcio-wheels>
Process Process-1:
Traceback (most recent call last):
File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
self.run()
File "/usr/lib/python2.7/multiprocessing/process.py", line 114, in run
self._target(*self._args, **self._kwargs)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/54712b50/beam/sdks/python/gen_protos.py",> line 149, in _install_grpcio_tools_and_generate_proto_files
shutil.rmtree(build_path)
File "/usr/lib/python2.7/shutil.py", line 239, in rmtree
onerror(os.listdir, path, sys.exc_info())
File "/usr/lib/python2.7/shutil.py", line 237, in rmtree
names = os.listdir(path)
OSError: [Errno 2] No such file or directory: '<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/54712b50/beam/sdks/python/.eggs/grpcio-wheels-build'>
Traceback (most recent call last):
File "setup.py", line 235, in <module>
'test': generate_protos_first(test),
File "/usr/local/lib/python2.7/dist-packages/setuptools/__init__.py", line 129, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python2.7/distutils/core.py", line 151, in setup
dist.run_commands()
File "/usr/lib/python2.7/distutils/dist.py", line 953, in run_commands
self.run_command(cmd)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "/usr/lib/python2.7/distutils/command/build.py", line 128, in run
self.run_command(cmd_name)
File "/usr/lib/python2.7/distutils/cmd.py", line 326, in run_command
self.distribution.run_command(command)
File "/usr/lib/python2.7/distutils/dist.py", line 972, in run_command
cmd_obj.run()
File "setup.py", line 141, in run
gen_protos.generate_proto_files()
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/54712b50/beam/sdks/python/gen_protos.py",> line 97, in generate_proto_files
raise ValueError("Proto generation failed (see log for details).")
ValueError: Proto generation failed (see log for details).
2018-04-14 12:42:33,809 54712b50 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-14 12:42:33,819 54712b50 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-14 12:42:33,820 54712b50 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-14 12:42:33,821 54712b50 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 267, in _BuildPythonCommand
raise RuntimeError('No python binary is found')
RuntimeError: No python binary is found
2018-04-14 12:42:33,821 54712b50 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-14 12:42:33,867 54712b50 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-14 12:42:33,868 54712b50 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/54712b50/pkb.log>
2018-04-14 12:42:33,868 54712b50 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/54712b50/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1146
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1146/display/redirect?page=changes>
Changes:
[altay] Cythonize DistributionAccumulator
------------------------------------------
[...truncated 2.82 KB...]
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins578814503430784470.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7933787431305222488.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Installing collected packages: numpy
Found existing installation: numpy 1.12.1
Not uninstalling numpy at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Successfully installed numpy-1.13.3
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1407950638471605540.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Using cached grpcio-1.11.0-cp27-cp27mu-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: grpcio, hdfs, pytz, nose, apache-beam
Found existing installation: grpcio 1.4.0
Not uninstalling grpcio at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Found existing installation: apache-beam 2.5.0.dev0
Not uninstalling apache-beam at /home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_AvroIOIT/src/sdks/python, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Running setup.py develop for apache-beam
Successfully installed apache-beam grpcio-1.11.0 hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins9139992651223697180.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-14 06:01:00,650 42eefa6c MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/42eefa6c/pkb.log>
2018-04-14 06:01:00,650 42eefa6c MainThread INFO PerfKitBenchmarker version: v1.12.0-489-gf0acf31
2018-04-14 06:01:00,651 42eefa6c MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-14 06:01:00,935 42eefa6c MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-14 06:01:00,936 42eefa6c MainThread INFO Initializing the edw service decoder
2018-04-14 06:01:01,106 42eefa6c MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-14 06:01:01,110 42eefa6c MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-14 06:01:01,111 42eefa6c MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-14 06:01:11,632 42eefa6c MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-14 06:10:27,119 42eefa6c MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-14 06:10:27,137 42eefa6c MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/42eefa6c/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-14 06:10:27,735 42eefa6c MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/42eefa6c/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-14 06:10:27,736 42eefa6c MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-14 06:10:27,737 42eefa6c MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-14 06:10:27,739 42eefa6c MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-14 06:10:27,740 42eefa6c MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-14 06:10:27,750 42eefa6c MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-14 06:10:27,751 42eefa6c MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/42eefa6c/pkb.log>
2018-04-14 06:10:27,751 42eefa6c MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/42eefa6c/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1145
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1145/display/redirect?page=changes>
Changes:
[sidhom] Support impulse transforms in Flink
[sidhom] Add Impulse ValidatesRunner test
[tgroh] Fix materializesWithDifferentEnvConsumer
[tgroh] Reduce Requirements to be considered a Primitve
[sidhom] [BEAM-3994] Use typed client pool sinks and sources
[sidhom] [BEAM-3966] Move functional utilities into shared module
[sidhom] Use general functional interfaces in ControlClientPool
[sidhom] Rename createLinked() to createBuffered() in QueueControlClientPool
[github] Add region argument to dataflow.go
[github] Region isn't on proto; create and get instead.
[tgroh] Rename `defaultRegistry` to `javaSdkNativeRegistry`
------------------------------------------
[...truncated 1.59 KB...]
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5085559925769131430.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5453358588492534264.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6176801820245075992.sh
+ virtualenv .env --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/bin/python>
Installing setuptools, pip, wheel...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7881018483447747870.sh
+ .env/bin/pip install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages
Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1382017487847733604.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6329806670362399871.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Installing collected packages: numpy
Found existing installation: numpy 1.12.1
Not uninstalling numpy at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Successfully installed numpy-1.13.3
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6320553170172132010.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0)
Using cached grpcio-1.11.0-cp27-cp27mu-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: grpcio, hdfs, pytz, nose, apache-beam
Found existing installation: grpcio 1.3.5
Not uninstalling grpcio at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Running setup.py develop for apache-beam
Successfully installed apache-beam grpcio-1.11.0 hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1047149932653330851.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-14 00:47:21,544 8ded84b7 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8ded84b7/pkb.log>
2018-04-14 00:47:21,544 8ded84b7 MainThread INFO PerfKitBenchmarker version: v1.12.0-489-gf0acf31
2018-04-14 00:47:21,545 8ded84b7 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-14 00:47:21,733 8ded84b7 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-14 00:47:21,734 8ded84b7 MainThread INFO Initializing the edw service decoder
2018-04-14 00:47:21,886 8ded84b7 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-14 00:47:21,889 8ded84b7 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-14 00:47:21,890 8ded84b7 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-14 00:47:29,116 8ded84b7 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-14 00:55:39,343 8ded84b7 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-14 00:55:39,358 8ded84b7 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8ded84b7/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-14 00:55:39,904 8ded84b7 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8ded84b7/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-14 00:55:39,905 8ded84b7 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-14 00:55:39,906 8ded84b7 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-14 00:55:39,908 8ded84b7 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-14 00:55:39,908 8ded84b7 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-14 00:55:39,941 8ded84b7 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-14 00:55:39,942 8ded84b7 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8ded84b7/pkb.log>
2018-04-14 00:55:39,942 8ded84b7 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8ded84b7/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1144
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1144/display/redirect?page=changes>
Changes:
[ehudm] Add lint checks for modules under sdks/python/.
[kedin] Add Row Json Deserializer
[kedin] Add RowJsonValueExtractors
[aaltay] [BEAM-4028] Adding NameContext to Python SDK. (#5043)
------------------------------------------
[...truncated 2.78 KB...]
Successfully installed setuptools pip
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1282056347515699854.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6350825671478846649.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Installing collected packages: numpy
Found existing installation: numpy 1.12.1
Not uninstalling numpy at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Successfully installed numpy-1.13.3
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins3862584342855888173.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Using cached grpcio-1.10.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: grpcio, hdfs, pytz, nose, apache-beam
Found existing installation: grpcio 1.3.5
Not uninstalling grpcio at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Running setup.py develop for apache-beam
Successfully installed apache-beam grpcio-1.10.1 hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1185209445493120813.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-13 18:00:51,002 f56cf86d MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f56cf86d/pkb.log>
2018-04-13 18:00:51,002 f56cf86d MainThread INFO PerfKitBenchmarker version: v1.12.0-489-gf0acf31
2018-04-13 18:00:51,003 f56cf86d MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-13 18:00:51,327 f56cf86d MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-13 18:00:51,327 f56cf86d MainThread INFO Initializing the edw service decoder
2018-04-13 18:00:51,474 f56cf86d MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-13 18:00:51,478 f56cf86d MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-13 18:00:51,478 f56cf86d MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-13 18:01:00,697 f56cf86d MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-13 18:10:21,900 f56cf86d MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-13 18:10:21,919 f56cf86d MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f56cf86d/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-13 18:10:24,371 f56cf86d MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f56cf86d/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-13 18:10:24,372 f56cf86d MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-13 18:10:24,430 f56cf86d MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-13 18:10:24,432 f56cf86d MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-13 18:10:24,432 f56cf86d MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-13 18:10:24,491 f56cf86d MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-13 18:10:24,492 f56cf86d MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f56cf86d/pkb.log>
2018-04-13 18:10:24,493 f56cf86d MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/f56cf86d/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1143
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1143/display/redirect>
------------------------------------------
[...truncated 2.06 KB...]
+ .env/bin/pip install --upgrade setuptools pip
Downloading/unpacking setuptools from https://pypi.python.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl#md5=ca299c7acd13a72e1171a3697f2b99bc
Downloading/unpacking pip from https://pypi.python.org/packages/ac/95/a05b56bb975efa78d3557efa36acaf9cf5d2fd0ee0062060493687432e03/pip-9.0.3-py2.py3-none-any.whl#md5=d512ceb964f38ba31addb8142bc657cb
Installing collected packages: setuptools, pip
Found existing installation: setuptools 2.2
Uninstalling setuptools:
Successfully uninstalled setuptools
Found existing installation: pip 1.5.4
Uninstalling pip:
Successfully uninstalled pip
Successfully installed setuptools pip
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7581625697249989454.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5340097789603159437.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied: numpy==1.13.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied: functools32 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /usr/local/lib/python2.7/dist-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /usr/local/lib/python2.7/dist-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins2347442769916928118.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: grpcio<2,>=1.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python2.7/dist-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: hdfs, pytz, nose, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins8891130557510675919.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-13 12:00:50,160 7f6832e4 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/7f6832e4/pkb.log>
2018-04-13 12:00:50,160 7f6832e4 MainThread INFO PerfKitBenchmarker version: v1.12.0-489-gf0acf31
2018-04-13 12:00:50,160 7f6832e4 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-13 12:00:50,579 7f6832e4 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-13 12:00:50,580 7f6832e4 MainThread INFO Initializing the edw service decoder
2018-04-13 12:00:50,721 7f6832e4 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-13 12:00:50,724 7f6832e4 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-13 12:00:50,724 7f6832e4 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-13 12:00:58,412 7f6832e4 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-13 12:08:31,611 7f6832e4 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-13 12:08:31,626 7f6832e4 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/7f6832e4/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-13 12:08:32,115 7f6832e4 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/7f6832e4/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-13 12:08:32,116 7f6832e4 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-13 12:08:32,117 7f6832e4 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-13 12:08:32,118 7f6832e4 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-13 12:08:32,119 7f6832e4 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-13 12:08:32,126 7f6832e4 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-13 12:08:32,127 7f6832e4 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/7f6832e4/pkb.log>
2018-04-13 12:08:32,127 7f6832e4 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/7f6832e4/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1142
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1142/display/redirect?page=changes>
Changes:
[tgroh] Remove AppliedPTransform methods in WatermarkManager
[tgroh] Add an ExecutableGraph interface
[tgroh] Genericise WatermarkManager and Dependencies
------------------------------------------
[...truncated 2.06 KB...]
+ .env/bin/pip install --upgrade setuptools pip
Downloading/unpacking setuptools from https://pypi.python.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl#md5=ca299c7acd13a72e1171a3697f2b99bc
Downloading/unpacking pip from https://pypi.python.org/packages/ac/95/a05b56bb975efa78d3557efa36acaf9cf5d2fd0ee0062060493687432e03/pip-9.0.3-py2.py3-none-any.whl#md5=d512ceb964f38ba31addb8142bc657cb
Installing collected packages: setuptools, pip
Found existing installation: setuptools 2.2
Uninstalling setuptools:
Successfully uninstalled setuptools
Found existing installation: pip 1.5.4
Uninstalling pip:
Successfully uninstalled pip
Successfully installed setuptools pip
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6738451038894981150.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins957109676271816493.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied: numpy==1.13.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied: functools32 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /usr/local/lib/python2.7/dist-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /usr/local/lib/python2.7/dist-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7624852320416540577.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: grpcio<2,>=1.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python2.7/dist-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: hdfs, pytz, nose, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7701903884323862319.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-13 06:00:53,676 1f98b06e MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1f98b06e/pkb.log>
2018-04-13 06:00:53,676 1f98b06e MainThread INFO PerfKitBenchmarker version: v1.12.0-489-gf0acf31
2018-04-13 06:00:53,677 1f98b06e MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-13 06:00:54,147 1f98b06e MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-13 06:00:54,147 1f98b06e MainThread INFO Initializing the edw service decoder
2018-04-13 06:00:54,284 1f98b06e MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-13 06:00:54,287 1f98b06e MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-13 06:00:54,287 1f98b06e MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-13 06:01:03,143 1f98b06e MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-13 06:09:11,360 1f98b06e MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-13 06:09:11,374 1f98b06e MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1f98b06e/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-13 06:09:11,860 1f98b06e MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1f98b06e/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-13 06:09:11,861 1f98b06e MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-13 06:09:11,862 1f98b06e MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-13 06:09:11,864 1f98b06e MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-13 06:09:11,864 1f98b06e MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-13 06:09:11,914 1f98b06e MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-13 06:09:11,915 1f98b06e MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1f98b06e/pkb.log>
2018-04-13 06:09:11,915 1f98b06e MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1f98b06e/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1141
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1141/display/redirect?page=changes>
Changes:
[tgroh] Add a ModelCoders class for Coder Utilities
[tgroh] Use ModelCoders in LengthPrefixUnknownCoders
[tgroh] Format UrnUtils
[XuMingmin] [BEAM-3983] [SQL] Tables interface supports BigQuery (#4991)
[kedin] [SQL] Infer Row type from input elements
------------------------------------------
[...truncated 1.73 KB...]
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins2501330811125783405.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins3397838017857592644.sh
+ virtualenv .env --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/bin/python>
Installing setuptools, pip, wheel...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7634402207774371508.sh
+ .env/bin/pip install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages
Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5609036226433070593.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins3346274903289497878.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Installing collected packages: numpy
Found existing installation: numpy 1.11.3
Not uninstalling numpy at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Successfully installed numpy-1.13.3
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins8875741216754461733.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0)
Using cached grpcio-1.10.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: grpcio, hdfs, pytz, nose, apache-beam
Found existing installation: grpcio 1.4.0
Not uninstalling grpcio at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Found existing installation: apache-beam 2.5.0.dev0
Not uninstalling apache-beam at /home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_TextIOIT/src/sdks/python, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Running setup.py develop for apache-beam
Successfully installed apache-beam grpcio-1.10.1 hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins2761580177036454530.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-13 00:34:51,474 593df400 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/593df400/pkb.log>
2018-04-13 00:34:51,474 593df400 MainThread INFO PerfKitBenchmarker version: v1.12.0-489-gf0acf31
2018-04-13 00:34:51,475 593df400 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-13 00:34:51,773 593df400 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-13 00:34:51,773 593df400 MainThread INFO Initializing the edw service decoder
2018-04-13 00:34:51,892 593df400 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-13 00:34:51,895 593df400 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-13 00:34:51,895 593df400 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-13 00:34:58,620 593df400 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-13 00:43:22,445 593df400 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-13 00:43:22,470 593df400 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/593df400/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-13 00:43:23,285 593df400 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/593df400/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-13 00:43:23,286 593df400 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-13 00:43:23,287 593df400 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-13 00:43:23,290 593df400 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-13 00:43:23,290 593df400 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-13 00:43:23,336 593df400 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-13 00:43:23,337 593df400 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/593df400/pkb.log>
2018-04-13 00:43:23,337 593df400 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/593df400/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1140
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1140/display/redirect?page=changes>
Changes:
[shoyer] [BEAM-3956] Preserve stacktraces for Python exceptions
[XuMingmin] KafkaIO : fix a typo in method name. (#5106)
------------------------------------------
[...truncated 3.98 KB...]
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins2156203211161947545.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Using cached https://files.pythonhosted.org/packages/eb/be/737f3df5806192ac4096e549e48c8c76cfaa2fb880a1c62a7bb085adaa9b/numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Installing collected packages: numpy
Found existing installation: numpy 1.12.1
Not uninstalling numpy at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Successfully installed numpy-1.13.3
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins8843553392024119434.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Using cached https://files.pythonhosted.org/packages/61/20/75ac3d6dca2880c2086c27d984de5d9583de68720f2925ee085aadb286d3/grpcio-1.10.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Using cached https://files.pythonhosted.org/packages/dc/83/15f7833b70d3e067ca91467ca245bae0f6fe56ddc7451aa0dc5606b120f2/pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: grpcio, hdfs, pytz, nose, apache-beam
Found existing installation: grpcio 1.3.5
Not uninstalling grpcio at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Running setup.py develop for apache-beam
Successfully installed apache-beam grpcio-1.10.1 hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins9164057897115840406.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-12 18:06:54,548 745b6f90 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/745b6f90/pkb.log>
2018-04-12 18:06:54,548 745b6f90 MainThread INFO PerfKitBenchmarker version: v1.12.0-486-gaf1f6c2
2018-04-12 18:06:54,548 745b6f90 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-12 18:06:54,871 745b6f90 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-12 18:06:54,871 745b6f90 MainThread INFO Initializing the edw service decoder
2018-04-12 18:06:55,016 745b6f90 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-12 18:06:55,020 745b6f90 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-12 18:06:55,020 745b6f90 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-12 18:07:02,375 745b6f90 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-12 18:14:50,113 745b6f90 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-12 18:14:50,127 745b6f90 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/745b6f90/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-12 18:14:50,696 745b6f90 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/745b6f90/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-12 18:14:50,697 745b6f90 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-12 18:14:50,698 745b6f90 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-12 18:14:50,699 745b6f90 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-12 18:14:50,700 745b6f90 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-12 18:14:50,753 745b6f90 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-12 18:14:50,754 745b6f90 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/745b6f90/pkb.log>
2018-04-12 18:14:50,754 745b6f90 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/745b6f90/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user shoyer@google.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1139
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1139/display/redirect>
------------------------------------------
[...truncated 2.03 KB...]
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1619728425473668548.sh
+ .env/bin/pip install --upgrade setuptools pip
Downloading/unpacking setuptools from https://pypi.python.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl#md5=ca299c7acd13a72e1171a3697f2b99bc
Downloading/unpacking pip from https://pypi.python.org/packages/ac/95/a05b56bb975efa78d3557efa36acaf9cf5d2fd0ee0062060493687432e03/pip-9.0.3-py2.py3-none-any.whl#md5=d512ceb964f38ba31addb8142bc657cb
Installing collected packages: setuptools, pip
Found existing installation: setuptools 2.2
Uninstalling setuptools:
Successfully uninstalled setuptools
Found existing installation: pip 1.5.4
Uninstalling pip:
Successfully uninstalled pip
Successfully installed setuptools pip
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6635476947246875465.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins34313267429360283.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied: numpy==1.13.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied: functools32 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /usr/local/lib/python2.7/dist-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /usr/local/lib/python2.7/dist-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins4415526075069650681.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: grpcio<2,>=1.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python2.7/dist-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: hdfs, pytz, nose, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1647354511528848738.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-12 12:00:56,715 19693ad6 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/19693ad6/pkb.log>
2018-04-12 12:00:56,716 19693ad6 MainThread INFO PerfKitBenchmarker version: v1.12.0-485-g4e039b9
2018-04-12 12:00:56,717 19693ad6 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-12 12:00:57,251 19693ad6 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-12 12:00:57,251 19693ad6 MainThread INFO Initializing the edw service decoder
2018-04-12 12:00:57,411 19693ad6 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-12 12:00:57,415 19693ad6 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-12 12:00:57,415 19693ad6 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-12 12:01:06,357 19693ad6 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-12 12:09:23,357 19693ad6 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-12 12:09:23,371 19693ad6 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/19693ad6/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-12 12:09:23,856 19693ad6 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/19693ad6/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-12 12:09:23,857 19693ad6 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-12 12:09:23,857 19693ad6 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-12 12:09:23,859 19693ad6 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-12 12:09:23,859 19693ad6 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-12 12:09:23,903 19693ad6 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-12 12:09:23,904 19693ad6 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/19693ad6/pkb.log>
2018-04-12 12:09:23,904 19693ad6 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/19693ad6/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1138
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1138/display/redirect>
------------------------------------------
[...truncated 2.85 KB...]
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins3296265926535067531.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins8765885189124877478.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Installing collected packages: numpy
Found existing installation: numpy 1.12.1
Not uninstalling numpy at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Successfully installed numpy-1.13.3
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins4145437599322082062.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Using cached grpcio-1.10.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: grpcio, hdfs, pytz, nose, apache-beam
Found existing installation: grpcio 1.4.0
Not uninstalling grpcio at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Found existing installation: apache-beam 2.5.0.dev0
Not uninstalling apache-beam at /home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_AvroIOIT/src/sdks/python, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Running setup.py develop for apache-beam
Successfully installed apache-beam grpcio-1.10.1 hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins8933069644529223028.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-12 06:00:48,607 fe003b42 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/fe003b42/pkb.log>
2018-04-12 06:00:48,607 fe003b42 MainThread INFO PerfKitBenchmarker version: v1.12.0-485-g4e039b9
2018-04-12 06:00:48,608 fe003b42 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-12 06:00:49,070 fe003b42 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-12 06:00:49,071 fe003b42 MainThread INFO Initializing the edw service decoder
2018-04-12 06:00:49,283 fe003b42 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-12 06:00:49,289 fe003b42 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-12 06:00:49,290 fe003b42 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-12 06:01:00,444 fe003b42 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-12 06:13:38,845 fe003b42 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-12 06:13:38,903 fe003b42 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/fe003b42/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-12 06:13:41,130 fe003b42 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/fe003b42/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-12 06:13:41,131 fe003b42 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-12 06:13:41,133 fe003b42 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-12 06:13:41,135 fe003b42 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-12 06:13:41,136 fe003b42 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-12 06:13:41,210 fe003b42 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-12 06:13:41,210 fe003b42 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/fe003b42/pkb.log>
2018-04-12 06:13:41,211 fe003b42 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/fe003b42/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1137
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1137/display/redirect?page=changes>
Changes:
[swegner] Publish a build scan from Jenkins build
[swegner] Migrate a few more references to Maven from our README.md
[amyrvold] [BEAM-4053] Add a Go postcommit
[lcwik] [BEAM-3249] Only generate all artifacts when publishing.
[ehudm] Clean up docker networks generated by hdfs integration tests.
[swegner] Add comment about build scans only on Jenkins
[chamikara] Updates gcsio to use a API specific batch endpoint.
------------------------------------------
[...truncated 1.62 KB...]
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7847917087091308028.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins4764724376474456743.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins140245675040456348.sh
+ virtualenv .env --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/bin/python>
Installing setuptools, pip, wheel...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1524304689042729770.sh
+ .env/bin/pip install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages
Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins2592019467096105231.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5790369867633706259.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Installing collected packages: numpy
Found existing installation: numpy 1.12.1
Not uninstalling numpy at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Successfully installed numpy-1.13.3
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5243414037745260798.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0)
Using cached grpcio-1.10.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: grpcio, hdfs, pytz, nose, apache-beam
Found existing installation: grpcio 1.3.5
Not uninstalling grpcio at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Running setup.py develop for apache-beam
Successfully installed apache-beam grpcio-1.10.1 hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7176268981901172352.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-12 00:08:31,743 e6889e30 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e6889e30/pkb.log>
2018-04-12 00:08:31,744 e6889e30 MainThread INFO PerfKitBenchmarker version: v1.12.0-485-g4e039b9
2018-04-12 00:08:31,744 e6889e30 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-12 00:08:31,987 e6889e30 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-12 00:08:31,988 e6889e30 MainThread INFO Initializing the edw service decoder
2018-04-12 00:08:32,116 e6889e30 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-12 00:08:32,119 e6889e30 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-12 00:08:32,119 e6889e30 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-12 00:08:39,228 e6889e30 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-12 00:17:36,634 e6889e30 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-12 00:17:36,648 e6889e30 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e6889e30/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-12 00:17:37,183 e6889e30 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e6889e30/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-12 00:17:37,184 e6889e30 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-12 00:17:37,184 e6889e30 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-12 00:17:37,186 e6889e30 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-12 00:17:37,186 e6889e30 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-12 00:17:37,214 e6889e30 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-12 00:17:37,214 e6889e30 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e6889e30/pkb.log>
2018-04-12 00:17:37,214 e6889e30 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/e6889e30/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1136
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1136/display/redirect?page=changes>
Changes:
[rezarokni] initial commit for BEAM-2871. WIP Todo: Add in the unit tests to work
[relax] Update python version.
[relax] Update container version.
[kirpichov] Cherrypick of #3995 to 2.2.0: Add custom tempLocation support to
[jbonofre] [BEAM-1017] Add RedisIO
[kenn] Use 2.2.0 container tag for Dataflow
[chamikara] Sets user agent in BigTableIO.Read.getBigTableService().
[valentyn] Pin runner harness container image for Dataflow distributions of BEAM
[valentyn] Make linter happy.
[valentyn] [BEAM-2600] Add minimal python SDK harness container
[valentyn] Use 2.2.0 version instead of 2.3.0 for container Maven project on the
[valentyn] Use tox instead of detox. Looks like we reverted to tox on the master
[valentyn] Pin runner harness also for official BEAM releases.
[relax] [maven-release-plugin] prepare release
[relax] [maven-release-plugin] prepare for next development iteration
[relax] Revert "[maven-release-plugin] prepare for next development iteration"
[relax] Revert "[maven-release-plugin] prepare release
[relax] [maven-release-plugin] prepare release v2.2.0-RC1
[relax] [maven-release-plugin] rollback changes from release preparation of
[altay] Add an element batching transform.
[altay] Align names with those produced by the dataflow runner harness.
[altay] Fix from any -> bytes transition.
[altay] Add an option for dataflow job labels.
[altay] Unit test for label pipeline option
[altay] Update container version for python DataflowRunner for the 2.2.0 release
[relax] [maven-release-plugin] prepare release v2.2.0-RC2
[relax] [maven-release-plugin] rollback changes from release preparation of
[relax] [maven-release-plugin] prepare release v2.2.0-RC3
[relax] [maven-release-plugin] rollback changes from release preparation of
[valentyn] Set save_main_session to True for csv module
[valentyn] Set OnTimeBehavior in windowing strategy to FIRE_ALWAYS.
[valentyn] Update urns.py
[ccy] CP #4112, #4122: Properly handle side input exception when all reader
[relax] Cherrypick WriteFiles fix.
[relax] [maven-release-plugin] prepare release v2.2.0-RC4
[relax] [maven-release-plugin] rollback changes from release preparation of
[rezarokni] initial commit for BEAM-2871. WIP Todo: Add in the unit tests to work
[rezarokni] [maven-release-plugin] prepare for next development iteration
[rezarokni] Bump Python version for next release.
[rezarokni] Only fail nightly release at end, for more detailed signal
[rezarokni] Only fail Java postcommit at end
[rezarokni] Move the Job Server into a Submodule
[rezarokni] Add Artifact Staging Endpoint to PrepareJobResponse
[rezarokni] Add model/ and submodules to Maven structure and gen_protos.py
[rezarokni] Move sdk/common/runner-api protos into model/pipeline and
[rezarokni] Move sdks/common/fn-api protos to model/fn-execution
[rezarokni] Remove sdks/common
[rezarokni] Re-namespace model/pipeline to model.pipeline
[rezarokni] Re-namespace model/job-management to model.job_management
[rezarokni] Re-namespace model/fn-execution to model.fn_execution
[rezarokni] Improve error message when standard_coders.yaml not found
[rezarokni] Dataflow runner: shade protobuf and beam model
[rezarokni] PipelineOptionsFactory should prevent non PipelineOptions interfaces
[rezarokni] [BEAM-3016] Fix blocking issue within run() when channel terminates
[rezarokni] [BEAM-2576] Reflect portability proto changes in Go
[rezarokni] Add licenses to generated code
[rezarokni] Improve the documentation for CombineFn
[rezarokni] Remove coders from DoFn's Remove extra space in hello.cc file Remove
[rezarokni] Fix Bug if more than one external lib DoFn is used in same pipeline the
[rezarokni] Removed more complex examples for later PR Added semaphore logic to
[7542791+rezarokni] Added Assert for test pipeline. Added comments and new file names for
[7542791+rezarokni] Added ability to read Binary output from files for use with Protobuf
[7542791+rezarokni] Moved files from java8 to java
[7542791+rezarokni] Correct checkstyle issues
[amyrvold] [BEAM-4035] Fix spark validatesrunner
[amyrvold] Change ver of zookeeper instead of removing mavenLocal
[7542791+rezarokni] Fix findBugs issues
[lcwik] [BEAM-3249, BEAM-4014] Automatically propagate shading configuration to
[lcwik] [BEAM-3249] Add support for translating 'provided' scope dependencies to
[kenn] Basic run task for nexmark with runner selection
------------------------------------------
[...truncated 1.63 KB...]
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins2607328252619943026.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1366556890383245229.sh
+ virtualenv .env --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/bin/python>
Installing setuptools, pip, wheel...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins297334369144073779.sh
+ .env/bin/pip install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages
Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5179966366160117575.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5009690477420920034.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Installing collected packages: numpy
Found existing installation: numpy 1.11.3
Not uninstalling numpy at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Successfully installed numpy-1.13.3
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1439504510777788505.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0)
Using cached grpcio-1.10.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: grpcio, hdfs, pytz, nose, apache-beam
Found existing installation: grpcio 1.3.5
Not uninstalling grpcio at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Found existing installation: apache-beam 2.5.0.dev0
Not uninstalling apache-beam at /home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_TextIOIT/src/sdks/python, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Running setup.py develop for apache-beam
Successfully installed apache-beam grpcio-1.10.1 hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins435660883398492763.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-11 18:31:09,802 591b2fe8 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/591b2fe8/pkb.log>
2018-04-11 18:31:09,802 591b2fe8 MainThread INFO PerfKitBenchmarker version: v1.12.0-478-g2db3b21
2018-04-11 18:31:09,803 591b2fe8 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-11 18:31:09,968 591b2fe8 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-11 18:31:09,969 591b2fe8 MainThread INFO Initializing the edw service decoder
2018-04-11 18:31:10,099 591b2fe8 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-11 18:31:10,102 591b2fe8 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-11 18:31:10,103 591b2fe8 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-11 18:31:17,181 591b2fe8 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-11 18:39:55,803 591b2fe8 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-11 18:39:55,816 591b2fe8 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/591b2fe8/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-11 18:39:56,337 591b2fe8 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/591b2fe8/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-11 18:39:56,338 591b2fe8 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-11 18:39:56,339 591b2fe8 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-11 18:39:56,341 591b2fe8 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-11 18:39:56,341 591b2fe8 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-11 18:39:56,364 591b2fe8 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-11 18:39:56,364 591b2fe8 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/591b2fe8/pkb.log>
2018-04-11 18:39:56,364 591b2fe8 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/591b2fe8/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 7542791+rezarokni@users.noreply.github.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user rezarokni@google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user valentyn@google.com
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1135
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1135/display/redirect?page=changes>
Changes:
[timrobertson100] [BEAM-3201] provide per-document routing (index/type and document id)
------------------------------------------
[...truncated 1.41 KB...]
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins4381986382032696768.sh
+ rm -rf PerfKitBenchmarker
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7587224654806653881.sh
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7994865374704729872.sh
+ virtualenv .env --system-site-packages
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/bin/python>
Installing setuptools, pip, wheel...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1733418173427740306.sh
+ .env/bin/pip install --upgrade setuptools pip
Requirement already up-to-date: setuptools in ./.env/lib/python2.7/site-packages
Requirement already up-to-date: pip in ./.env/lib/python2.7/site-packages
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6710749080794780157.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins2645763024259902797.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Collecting numpy==1.13.3 (from -r PerfKitBenchmarker/requirements.txt (line 22))
Using cached numpy-1.13.3-cp27-cp27mu-manylinux1_x86_64.whl
Requirement already satisfied: functools32 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /home/jenkins/.local/lib/python2.7/site-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Installing collected packages: numpy
Found existing installation: numpy 1.12.1
Not uninstalling numpy at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Successfully installed numpy-1.13.3
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins4383914912529384498.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting grpcio<2,>=1.8 (from apache-beam==2.5.0.dev0)
Using cached grpcio-1.10.1-cp27-cp27mu-manylinux1_x86_64.whl
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /home/jenkins/.local/lib/python2.7/site-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /home/jenkins/.local/lib/python2.7/site-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.6,>=2.5 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.22,>=1.21.1 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /home/jenkins/.local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: grpcio, hdfs, pytz, nose, apache-beam
Found existing installation: grpcio 1.4.0
Not uninstalling grpcio at /home/jenkins/.local/lib/python2.7/site-packages, outside environment <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env>
Running setup.py develop for apache-beam
Successfully installed apache-beam grpcio-1.10.1 hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins7595547940701342463.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-11 12:01:03,652 af50f718 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/af50f718/pkb.log>
2018-04-11 12:01:03,652 af50f718 MainThread INFO PerfKitBenchmarker version: v1.12.0-478-g2db3b21
2018-04-11 12:01:03,653 af50f718 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-11 12:01:04,067 af50f718 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-11 12:01:04,068 af50f718 MainThread INFO Initializing the edw service decoder
2018-04-11 12:01:04,192 af50f718 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-11 12:01:04,195 af50f718 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-11 12:01:04,195 af50f718 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-11 12:01:11,516 af50f718 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-11 12:13:51,493 af50f718 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-11 12:13:51,777 af50f718 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/af50f718/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-11 12:13:57,200 af50f718 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/af50f718/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-11 12:13:57,201 af50f718 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-11 12:13:57,275 af50f718 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-11 12:13:57,277 af50f718 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-11 12:13:57,277 af50f718 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-11 12:13:57,309 af50f718 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-11 12:13:57,309 af50f718 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/af50f718/pkb.log>
2018-04-11 12:13:57,309 af50f718 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/af50f718/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user timrobertson100@gmail.com
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1134
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1134/display/redirect?page=changes>
Changes:
[robertwb] Use valid name for fake ArgSpec args.
[ccy] Update DataflowRunner to suppress duplicate system messages
[Pablo] Fixing data race in statesampler_fast.
[swegner] Decrease flink ValidatesRunner maxParallelForks from 4 to 2 in order to
[herohde] [BEAM-4015] Always update Go dependences in Maven build
[herohde] Update Go maven plugin
------------------------------------------
[...truncated 1.84 KB...]
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6458251481524553331.sh
+ virtualenv .env --system-site-packages
New python executable in .env/bin/python
Installing setuptools, pip...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6534466918144038700.sh
+ .env/bin/pip install --upgrade setuptools pip
Downloading/unpacking setuptools from https://pypi.python.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl#md5=ca299c7acd13a72e1171a3697f2b99bc
Downloading/unpacking pip from https://pypi.python.org/packages/ac/95/a05b56bb975efa78d3557efa36acaf9cf5d2fd0ee0062060493687432e03/pip-9.0.3-py2.py3-none-any.whl#md5=d512ceb964f38ba31addb8142bc657cb
Installing collected packages: setuptools, pip
Found existing installation: setuptools 2.2
Uninstalling setuptools:
Successfully uninstalled setuptools
Found existing installation: pip 1.5.4
Uninstalling pip:
Successfully uninstalled pip
Successfully installed setuptools pip
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins3844849458040639615.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1768250496408946833.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied: numpy==1.13.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied: functools32 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /usr/local/lib/python2.7/dist-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /usr/local/lib/python2.7/dist-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins2059427394420277927.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: grpcio<2,>=1.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Using cached pytz-2018.4-py2.py3-none-any.whl
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python2.7/dist-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: hdfs, pytz, nose, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins8216116116227074181.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-11 06:00:57,760 2fa18b0d MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/2fa18b0d/pkb.log>
2018-04-11 06:00:57,760 2fa18b0d MainThread INFO PerfKitBenchmarker version: v1.12.0-478-g2db3b21
2018-04-11 06:00:57,761 2fa18b0d MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-11 06:00:58,242 2fa18b0d MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-11 06:00:58,242 2fa18b0d MainThread INFO Initializing the edw service decoder
2018-04-11 06:00:58,431 2fa18b0d MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-11 06:00:58,434 2fa18b0d MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-11 06:00:58,435 2fa18b0d MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-11 06:01:06,995 2fa18b0d MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-11 06:09:58,357 2fa18b0d MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-11 06:09:58,372 2fa18b0d MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/2fa18b0d/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-11 06:09:58,885 2fa18b0d MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/2fa18b0d/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-11 06:09:58,886 2fa18b0d MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-11 06:09:58,886 2fa18b0d MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-11 06:09:58,888 2fa18b0d MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-11 06:09:58,888 2fa18b0d MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-11 06:09:58,909 2fa18b0d MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-11 06:09:58,909 2fa18b0d MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/2fa18b0d/pkb.log>
2018-04-11 06:09:58,909 2fa18b0d MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/2fa18b0d/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1133
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1133/display/redirect>
------------------------------------------
[...truncated 64.22 KB...]
[INFO] Copying 6 resources
[INFO]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1eded43c/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1eded43c/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1eded43c/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1eded43c/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1eded43c/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[INFO]
[INFO] ---------Exec.Out---------
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl/cmd [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/specialize [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/symtab [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam 0.083s
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/artifact 0.187s
[INFO]
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx
[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: undefined: option.WithoutAuthentication
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 23.393 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 13.835 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.427 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 38.360 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 17.348 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 23.470 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.945 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [01:27 min]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 03:35 min
[INFO] Finished at: 2018-04-11T01:20:33Z
[INFO] Final Memory: 82M/1051M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.6:test (go-test) on project beam-sdks-go: Process exit code : 2 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-11 01:20:34,706 1eded43c MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-11 01:20:34,722 1eded43c MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1eded43c/beam/sdks/python/target>
2018-04-11 01:20:34,724 1eded43c MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-11 01:20:34,727 1eded43c MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1eded43c/beam/sdks/python/target>
2018-04-11 01:20:34,737 1eded43c MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-11 01:20:34,779 1eded43c MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-11 01:20:34,779 1eded43c MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1eded43c/pkb.log>
2018-04-11 01:20:34,779 1eded43c MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/1eded43c/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1132
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1132/display/redirect>
------------------------------------------
[...truncated 62.98 KB...]
[INFO] Copying 6 resources
[INFO]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cd418357/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cd418357/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cd418357/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cd418357/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cd418357/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[INFO]
[INFO] ---------Exec.Out---------
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl/cmd [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/specialize [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/symtab [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam 0.015s
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/artifact 0.160s
[INFO]
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx
[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: undefined: option.WithoutAuthentication
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 13.081 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 6.136 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.177 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 9.708 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 3.658 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 3.944 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.171 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 26.648 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:08 min
[INFO] Finished at: 2018-04-11T01:09:22Z
[INFO] Final Memory: 89M/1386M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.6:test (go-test) on project beam-sdks-go: Process exit code : 2 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-11 01:09:23,125 cd418357 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-11 01:09:23,131 cd418357 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cd418357/beam/sdks/python/target>
2018-04-11 01:09:23,132 cd418357 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-11 01:09:23,134 cd418357 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cd418357/beam/sdks/python/target>
2018-04-11 01:09:23,134 cd418357 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-11 01:09:23,190 cd418357 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-11 01:09:23,191 cd418357 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cd418357/pkb.log>
2018-04-11 01:09:23,191 cd418357 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/cd418357/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1131
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1131/display/redirect?page=changes>
Changes:
[tgroh] Make EmptyInputProvider Javadoc more precise
[coheigea] Properly clean up HBase IO test data
[amyrvold] Fix validates container test by changing gradle target name
[1147435+chuanyu] Fix pickling for "recursive" classes.
[swegner] Disable Gradle agent for Jenkins build jobs.
[swegner] fixup! Add common Gradle switches to remaining jobs
[swegner] fixup! Execute switches on the passed-in context object
[swegner] fixup! Fix stale variable in java precommits
------------------------------------------
[...truncated 63.56 KB...]
[INFO] Copying 6 resources
[INFO]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/b2039896/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/b2039896/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/b2039896/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/b2039896/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/b2039896/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[INFO]
[INFO] ---------Exec.Out---------
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl/cmd [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/specialize [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/symtab [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam 0.025s
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/artifact 0.158s
[INFO]
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx
[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: undefined: option.WithoutAuthentication
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 9.620 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 7.580 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.197 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 22.952 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 13.013 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 19.820 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.622 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [01:11 min]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 02:32 min
[INFO] Finished at: 2018-04-11T00:24:02Z
[INFO] Final Memory: 84M/1133M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.6:test (go-test) on project beam-sdks-go: Process exit code : 2 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-11 00:24:04,010 b2039896 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-11 00:24:04,037 b2039896 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/b2039896/beam/sdks/python/target>
2018-04-11 00:24:04,039 b2039896 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-11 00:24:04,042 b2039896 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/b2039896/beam/sdks/python/target>
2018-04-11 00:24:04,042 b2039896 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-11 00:24:04,101 b2039896 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-11 00:24:04,101 b2039896 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/b2039896/pkb.log>
2018-04-11 00:24:04,102 b2039896 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/b2039896/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user 1147435+chuanyu@users.noreply.github.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1130
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1130/display/redirect?page=changes>
Changes:
[herohde] [BEAM-4031] Add more Go SDK Dataflow options
[iemejia] [BEAM-3848] Add retry configuration to SolrIO write
[aromanenko.dev] [BEAM-2852] Added Kafka source of events and sink of results
[aromanenko.dev] [BEAM-2852] Fix the code that uses Long key whereas there is no key in
[aromanenko.dev] [BEAM-2852] Fix minor code style issues
[iemejia] Remove accidentally forgotten binding for log4j12 on SolrIO
[rober] Remove panic when mutating a global option a second time.
------------------------------------------
[...truncated 60.42 KB...]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8a8a3dc3/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8a8a3dc3/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8a8a3dc3/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8a8a3dc3/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8a8a3dc3/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[INFO]
[INFO] ---------Exec.Out---------
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl/cmd [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/specialize [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/symtab [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam 0.019s
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/artifact 0.108s
[INFO]
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx
[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: undefined: option.WithoutAuthentication
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 3.224 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 3.359 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.122 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 11.340 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 3.273 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 3.796 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.177 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 26.147 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 52.903 s
[INFO] Finished at: 2018-04-10T18:13:32Z
[INFO] Final Memory: 83M/1096M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.6:test (go-test) on project beam-sdks-go: Process exit code : 2 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-10 18:13:32,553 8a8a3dc3 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-10 18:13:32,560 8a8a3dc3 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8a8a3dc3/beam/sdks/python/target>
2018-04-10 18:13:32,561 8a8a3dc3 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-10 18:13:32,563 8a8a3dc3 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 757, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 623, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 526, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8a8a3dc3/beam/sdks/python/target>
2018-04-10 18:13:32,563 8a8a3dc3 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-10 18:13:32,612 8a8a3dc3 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-10 18:13:32,612 8a8a3dc3 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8a8a3dc3/pkb.log>
2018-04-10 18:13:32,613 8a8a3dc3 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/8a8a3dc3/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1129
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1129/display/redirect>
------------------------------------------
[...truncated 1.75 KB...]
+ rm -rf .env
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1989193450022579917.sh
+ virtualenv .env --system-site-packages
New python executable in .env/bin/python
Installing setuptools, pip...done.
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins1971511173946215866.sh
+ .env/bin/pip install --upgrade setuptools pip
Downloading/unpacking setuptools from https://pypi.python.org/packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl#md5=ca299c7acd13a72e1171a3697f2b99bc
Downloading/unpacking pip from https://pypi.python.org/packages/ac/95/a05b56bb975efa78d3557efa36acaf9cf5d2fd0ee0062060493687432e03/pip-9.0.3-py2.py3-none-any.whl#md5=d512ceb964f38ba31addb8142bc657cb
Installing collected packages: setuptools, pip
Found existing installation: setuptools 2.2
Uninstalling setuptools:
Successfully uninstalled setuptools
Found existing installation: pip 1.5.4
Uninstalling pip:
Successfully uninstalled pip
Successfully installed setuptools pip
Cleaning up...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins9095883991703810179.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git
Cloning into 'PerfKitBenchmarker'...
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins5420397477646972140.sh
+ .env/bin/pip install -r PerfKitBenchmarker/requirements.txt
Requirement already satisfied: absl-py in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: jinja2>=2.7 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 16))
Requirement already satisfied: colorlog[windows]==2.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: blinker>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 18))
Requirement already satisfied: futures>=3.0.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 19))
Requirement already satisfied: PyYAML==3.12 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 20))
Requirement already satisfied: pint>=0.7 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 21))
Requirement already satisfied: numpy==1.13.3 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 22))
Requirement already satisfied: functools32 in /usr/local/lib/python2.7/dist-packages (from -r PerfKitBenchmarker/requirements.txt (line 23))
Requirement already satisfied: contextlib2>=0.5.1 in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 24))
Requirement already satisfied: pywinrm in /home/jenkins/.local/lib/python2.7/site-packages (from -r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: six in /usr/local/lib/python2.7/dist-packages (from absl-py->-r PerfKitBenchmarker/requirements.txt (line 14))
Requirement already satisfied: MarkupSafe>=0.23 in /usr/local/lib/python2.7/dist-packages (from jinja2>=2.7->-r PerfKitBenchmarker/requirements.txt (line 15))
Requirement already satisfied: colorama; extra == "windows" in /usr/lib/python2.7/dist-packages (from colorlog[windows]==2.6.0->-r PerfKitBenchmarker/requirements.txt (line 17))
Requirement already satisfied: xmltodict in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests-ntlm>=0.3.0 in /home/jenkins/.local/lib/python2.7/site-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: requests>=2.9.1 in /usr/local/lib/python2.7/dist-packages (from pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ntlm-auth>=1.0.2 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cryptography>=1.3 in /home/jenkins/.local/lib/python2.7/site-packages (from requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.9.1->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: cffi>=1.7; platform_python_implementation != "PyPy" in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: enum34; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: asn1crypto>=0.21.0 in /home/jenkins/.local/lib/python2.7/site-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: ipaddress; python_version < "3" in /usr/local/lib/python2.7/dist-packages (from cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
Requirement already satisfied: pycparser in /home/jenkins/.local/lib/python2.7/site-packages (from cffi>=1.7; platform_python_implementation != "PyPy"->cryptography>=1.3->requests-ntlm>=0.3.0->pywinrm->-r PerfKitBenchmarker/requirements.txt (line 25))
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins321984533054073960.sh
+ .env/bin/pip install -e 'src/sdks/python/[gcp,test]'
Obtaining file://<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/src/sdks/python>
Requirement already satisfied: avro<2.0.0,>=1.8.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: crcmod<2.0,>=1.7 in /usr/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: dill==0.2.6 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: grpcio<2,>=1.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting hdfs<3.0.0,>=2.1.0 (from apache-beam==2.5.0.dev0)
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:339: SNIMissingWarning: An HTTPS request has been made, but the SNI (Subject Name Indication) extension to TLS is not available on this platform. This may cause the server to present an incorrect TLS certificate, which can cause validation failures. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
SNIMissingWarning
<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/.env/local/lib/python2.7/site-packages/pip/_vendor/urllib3/util/ssl_.py>:137: InsecurePlatformWarning: A true SSLContext object is not available. This prevents urllib3 from configuring SSL appropriately and may cause certain SSL connections to fail. You can upgrade to a newer version of Python to solve this. For more information, see https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
InsecurePlatformWarning
Requirement already satisfied: httplib2<0.10,>=0.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: mock<3.0.0,>=1.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: oauth2client<5,>=2.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting pytz>=2018.3 (from apache-beam==2.5.0.dev0)
Downloading pytz-2018.4-py2.py3-none-any.whl (510kB)
Requirement already satisfied: pyyaml<4.0.0,>=3.12 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: pyvcf<0.7.0,>=0.6.8 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: six<1.12,>=1.9 in /usr/local/lib/python2.7/dist-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: typing<3.7.0,>=3.6.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: futures<4.0.0,>=3.1.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-apitools<=0.5.20,>=0.5.18 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: googledatastore==7.0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-pubsub==0.26.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: proto-google-cloud-pubsub-v1==0.15.4 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-bigquery==0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Collecting nose>=1.3.7 (from apache-beam==2.5.0.dev0)
Using cached nose-1.3.7-py2-none-any.whl
Requirement already satisfied: pyhamcrest<2.0,>=1.9 in /home/jenkins/.local/lib/python2.7/site-packages (from apache-beam==2.5.0.dev0)
Requirement already satisfied: enum34>=1.0.4 in /usr/local/lib/python2.7/dist-packages (from grpcio<2,>=1.8->apache-beam==2.5.0.dev0)
Requirement already satisfied: requests>=2.7.0 in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: docopt in /usr/local/lib/python2.7/dist-packages (from hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: funcsigs>=1; python_version < "3.3" in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pbr>=0.11 in /home/jenkins/.local/lib/python2.7/site-packages (from mock<3.0.0,>=1.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: rsa>=3.1.4 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1-modules>=0.0.5 in /home/jenkins/.local/lib/python2.7/site-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python2.7/dist-packages (from oauth2client<5,>=2.0.1->apache-beam==2.5.0.dev0)
Requirement already satisfied: setuptools in ./.env/lib/python2.7/site-packages (from protobuf<4,>=3.5.0.post1->apache-beam==2.5.0.dev0)
Requirement already satisfied: fasteners>=0.14 in /home/jenkins/.local/lib/python2.7/site-packages (from google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.5.2 in /home/jenkins/.local/lib/python2.7/site-packages (from proto-google-cloud-datastore-v1<=0.90.4,>=0.90.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-cloud-core<0.26dev,>=0.25.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/dist-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: monotonic>=0.1 in /home/jenkins/.local/lib/python2.7/site-packages (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-auth-httplib2 in /home/jenkins/.local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /home/jenkins/.local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: cachetools>=2.0.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Requirement already satisfied: ply==3.8 in /home/jenkins/.local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0)
Installing collected packages: hdfs, pytz, nose, apache-beam
Running setup.py develop for apache-beam
Successfully installed apache-beam hdfs-2.1.0 nose-1.3.7 pytz-2018.4
[beam_PerformanceTests_Python] $ /bin/bash -xe /tmp/jenkins6956034979669726800.sh
+ .env/bin/python PerfKitBenchmarker/pkb.py --project=apache-beam-testing --dpb_log_level=INFO --maven_binary=/home/jenkins/tools/maven/latest/bin/mvn --bigquery_table=beam_performance.pkb_results --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/> --official=true --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
2018-04-10 12:00:54,641 bad20693 MainThread INFO Verbose logging to: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bad20693/pkb.log>
2018-04-10 12:00:54,641 bad20693 MainThread INFO PerfKitBenchmarker version: v1.12.0-476-ga3e6c03
2018-04-10 12:00:54,642 bad20693 MainThread INFO Flag values:
--beam_sdk=python
--temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/>
--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output
--maven_binary=/home/jenkins/tools/maven/latest/bin/mvn
--project=apache-beam-testing
--bigquery_table=beam_performance.pkb_results
--official
--dpb_log_level=INFO
--benchmarks=beam_integration_benchmark
2018-04-10 12:00:54,932 bad20693 MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo.
2018-04-10 12:00:54,932 bad20693 MainThread INFO Initializing the edw service decoder
2018-04-10 12:00:55,105 bad20693 MainThread beam_integration_benchmark(1/1) INFO Provisioning resources for benchmark beam_integration_benchmark
2018-04-10 12:00:55,107 bad20693 MainThread beam_integration_benchmark(1/1) INFO Preparing benchmark beam_integration_benchmark
2018-04-10 12:00:55,108 bad20693 MainThread beam_integration_benchmark(1/1) INFO Running: git clone https://github.com/apache/beam.git
2018-04-10 12:01:03,179 bad20693 MainThread beam_integration_benchmark(1/1) INFO Running: /home/jenkins/tools/maven/latest/bin/mvn clean install -DskipTests -Dcheckstyle.skip=true -Pdataflow-runner
2018-04-10 12:08:24,839 bad20693 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-10 12:08:24,859 bad20693 MainThread beam_integration_benchmark(1/1) INFO Running: python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bad20693/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz>
2018-04-10 12:08:25,373 bad20693 MainThread beam_integration_benchmark(1/1) INFO Ran: {python setup.py nosetests --tests=apache_beam.examples.wordcount_it_test --attr=IT --test-pipeline-options="--project=apache-beam-testing" "--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it" "--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it" "--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output" --runner=TestDataflowRunner --sdk_location=<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bad20693/beam/sdks/python/target/apache-beam-2.5.0.dev0.tar.gz}> ReturnCode:1
STDOUT:
STDERR: /usr/local/lib/python2.7/dist-packages/setuptools/dist.py:397: UserWarning: Normalizing '2.5.0.dev' to '2.5.0.dev0'
normalized_version,
usage: setup.py [global_opts] cmd1 [cmd1_opts] [cmd2 [cmd2_opts] ...]
or: setup.py --help [cmd1 cmd2 ...]
or: setup.py --help-commands
or: setup.py cmd --help
error: invalid command 'nosetests'
2018-04-10 12:08:25,374 bad20693 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-10 12:08:25,375 bad20693 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-10 12:08:25,376 bad20693 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 758, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-04-10 12:08:25,377 bad20693 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-10 12:08:25,396 bad20693 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-10 12:08:25,396 bad20693 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bad20693/pkb.log>
2018-04-10 12:08:25,397 bad20693 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/bad20693/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1128
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1128/display/redirect?page=changes>
Changes:
[ccy] Fix missing clock bug in nested TriggerContext
[ccy] Real-time timers shouldn't stall completed step in DirectRunner
[ccy] Set RuntimeValueProvider runtime options in FnApiRunner
[ccy] Add streaming wordcount snippets and test
[ccy] Add Python trigger snippets and tests
------------------------------------------
[...truncated 61.75 KB...]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9b856d71/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9b856d71/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9b856d71/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9b856d71/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9b856d71/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[INFO]
[INFO] ---------Exec.Out---------
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl/cmd [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/specialize [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/symtab [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam 0.021s
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/artifact 0.079s
[INFO]
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx
[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: undefined: option.WithoutAuthentication
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 6.128 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 4.800 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.102 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 16.786 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 5.187 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 4.589 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.384 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 30.145 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:11 min
[INFO] Finished at: 2018-04-10T06:02:34Z
[INFO] Final Memory: 94M/937M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.6:test (go-test) on project beam-sdks-go: Process exit code : 2 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-10 06:02:34,655 9b856d71 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-10 06:02:34,661 9b856d71 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9b856d71/beam/sdks/python/target>
2018-04-10 06:02:34,662 9b856d71 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-10 06:02:34,663 9b856d71 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 758, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9b856d71/beam/sdks/python/target>
2018-04-10 06:02:34,663 9b856d71 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-10 06:02:34,670 9b856d71 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-10 06:02:34,671 9b856d71 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9b856d71/pkb.log>
2018-04-10 06:02:34,671 9b856d71 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9b856d71/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1127
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1127/display/redirect?page=changes>
Changes:
[daniel.o.programmer] [BEAM-3706] Removing SideInputs and Parameters from CombinePayload.
[daniel.o.programmer] [BEAM-3706] Removing side inputs from Combine translation logic.
[daniel.o.programmer] [BEAM-3706] Attempting to fix a findbug issue.
[daniel.o.programmer] [BEAM-3706] Cleaning up side input code in Flink runner.
[daniel.o.programmer] [BEAM-3706] Fixing issue in direct runner with side input combines.
[robertwb] Correctly account for keyword arguments in function calls.
[robertwb] Fix type inference for slicing.
[coheigea] Removing some null guards that are not needed
[lcwik] Get Spark validates runner streaming integration tests to use the
[lcwik] Speed up Spark post commit test run speed by running 4 tests
[lcwik] [BEAM-4014] Fix project evaluation order.
[herohde] Fix bad Gradle Go examples directory
[herohde] [BEAM-4034] Fix hooks panic with Go on Flink
[lcwik] [BEAM-4014] Fix class path for examplesJavaIntegrationTest, also fix
[robertwb] Revert "Revert #4781 which broke Python postsubmits"
[robertwb] Guard side input mutation for Fn API mode only.
[ehudm] Add grpcio-tools to gradle virtualenv.
[ehudm] Allow longs as input to Timestamp.of().
------------------------------------------
[...truncated 60.42 KB...]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9ccf8404/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9ccf8404/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9ccf8404/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9ccf8404/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9ccf8404/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[INFO]
[INFO] ---------Exec.Out---------
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl/cmd [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/specialize [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/symtab [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam 0.043s
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/artifact 0.118s
[INFO]
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx
[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: undefined: option.WithoutAuthentication
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 3.807 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 3.319 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.086 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 10.720 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 3.722 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 4.704 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 0.155 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 33.878 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:03 min
[INFO] Finished at: 2018-04-10T00:49:36Z
[INFO] Final Memory: 85M/1167M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.6:test (go-test) on project beam-sdks-go: Process exit code : 2 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-10 00:49:36,742 9ccf8404 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-10 00:49:36,749 9ccf8404 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9ccf8404/beam/sdks/python/target>
2018-04-10 00:49:36,751 9ccf8404 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-10 00:49:36,752 9ccf8404 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 758, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9ccf8404/beam/sdks/python/target>
2018-04-10 00:49:36,753 9ccf8404 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-10 00:49:36,763 9ccf8404 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-10 00:49:36,764 9ccf8404 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9ccf8404/pkb.log>
2018-04-10 00:49:36,764 9ccf8404 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/9ccf8404/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com
Build failed in Jenkins: beam_PerformanceTests_Python #1126
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/beam_PerformanceTests_Python/1126/display/redirect?page=changes>
Changes:
[lcwik] Attempt to produce release artifacts.
[lcwik] Sign the published artifacts.
[lcwik] Rename a few of the projects so that the artifact names are correctly
[lcwik] Rewrite even more names.
[lcwik] fixup! fix a few names
[swegner] Add Apache header into generated POM
[lcwik] Finish renaming the projects so that they produce valid maven artifact
[lcwik] Gate signing/publishing configuration on 'release', 'publishing' project
[swegner] Use correct project description in generated pom
[swegner] Add license to generated poms
[swegner] Add scm information to generated pom
[swegner] Add JIRA information to generated pom
[swegner] Add mailing list information to generated pom
[swegner] Add developer info to generated pom files
[swegner] Add top-level metadata to generate poms
[alan.myrvold] only sign when releasing, to avoid gpg erors
[lcwik] Add exclusion rules that are defined on the configuration and the
[lcwik] Only apply maven-publish / signing plugins if actually needed.
[lcwik] Fix relocated paths after renaming modules.
[swegner] Fix Apache license header in generated POM.
[swegner] fixup: tabs -> spaces
[lcwik] Publish shaded jars when signing
[lcwik] Mirate back to using compile as the dependency type since our archetypes
[lcwik] Also publish the beam-sdks-java-harness package.
[lcwik] Move signing configuration under same block that controls whether
[swegner] Add proper descriptions to generated pom files.
[lcwik] Minor description clean-ups.
[swegner] fixup: Update project name to new convention
[swegner2] Address some comments on PR/5048 (#19)
[swegner] Move generated pom configuration into build_rules.gradle.
[lcwik] [BEAM-4014] Replace the Java maven based PostCommit with a Gradle based
[amyrvold] [BEAM-3255] Move from maven to gradle with nightly builds
[github] Update job_beam_Release_Gradle_NightlySnapshot.groovy
[lcwik] [BEAM-4014] Remove previous names because this renames the existing job
------------------------------------------
[...truncated 62.77 KB...]
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 6 resources
[INFO]
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/52a43360/beam/sdks/go/target/beam-sdks-go-2.5.0-SNAPSHOT-pkg-sources.zip>
[INFO]
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get google.golang.org/grpc golang.org/x/oauth2/google google.golang.org/api/storage/v1 github.com/spf13/cobra cloud.google.com/go/bigquery google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/52a43360/beam/sdks/go/target/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/52a43360/beam/sdks/go/target/beamctl>
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/52a43360/beam/sdks/go/target/linux_amd64/beamctl> github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/52a43360/beam/sdks/go/target/linux_amd64/beamctl>
[INFO]
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO]
[INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[INFO]
[INFO] ---------Exec.Out---------
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/beamctl/cmd [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/specialize [no test files]
[INFO] ? github.com/apache/beam/sdks/go/cmd/symtab [no test files]
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam 0.019s
[INFO] ok github.com/apache/beam/sdks/go/pkg/beam/artifact 0.123s
[INFO]
[ERROR]
[ERROR] ---------Exec.Err---------
[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx
[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: undefined: option.WithoutAuthentication
[ERROR]
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Beam :: Parent .............................. SUCCESS [ 10.616 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools ......... SUCCESS [ 6.513 s]
[INFO] Apache Beam :: Model ............................... SUCCESS [ 0.108 s]
[INFO] Apache Beam :: Model :: Pipeline ................... SUCCESS [ 10.998 s]
[INFO] Apache Beam :: Model :: Job Management ............. SUCCESS [ 4.045 s]
[INFO] Apache Beam :: Model :: Fn Execution ............... SUCCESS [ 5.132 s]
[INFO] Apache Beam :: SDKs ................................ SUCCESS [ 1.032 s]
[INFO] Apache Beam :: SDKs :: Go .......................... FAILURE [ 29.499 s]
[INFO] Apache Beam :: SDKs :: Go :: Container ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java ........................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core SKIPPED
[INFO] Apache Beam :: Runners ............................. SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java ................ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .................. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .......... SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .............. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common ........ SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra ..... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: Common SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 2.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests :: 5.x SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: XML ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Protobuf SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Dataflow .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: File-based-io-tests SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Common . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop File System SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop Input Format SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HBase ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: HCatalog ...... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: JMS ........... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB ....... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Redis ......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Solr .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Tika .......... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes .... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Starter SKIPPED
[INFO] Apache Beam :: Examples ............................ SKIPPED
[INFO] Apache Beam :: Examples :: Java .................... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes :: Examples SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Jackson SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Join library SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sketching SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Sorter SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: SQL ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Nexmark ............. SKIPPED
[INFO] Apache Beam :: SDKs :: Python ...................... SKIPPED
[INFO] Apache Beam :: SDKs :: Python :: Container ......... SKIPPED
[INFO] Apache Beam :: Runners :: Java Fn Execution ........ SKIPPED
[INFO] Apache Beam :: Runners :: Java Local Artifact Service SKIPPED
[INFO] Apache Beam :: Runners :: Reference ................ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Java ........ SKIPPED
[INFO] Apache Beam :: Runners :: Reference :: Job Orchestrator SKIPPED
[INFO] Apache Beam :: Runners :: Flink .................... SKIPPED
[INFO] Apache Beam :: Runners :: Gearpump ................. SKIPPED
[INFO] Apache Beam :: Runners :: Spark .................... SKIPPED
[INFO] Apache Beam :: Runners :: Apex ..................... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform .... SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCE metadata provisioning SKIPPED
[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact proxy SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Aggregated Javadoc .. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:11 min
[INFO] Finished at: 2018-04-09T18:28:38Z
[INFO] Final Memory: 89M/1355M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal com.igormaznitsa:mvn-golang-wrapper:2.1.6:test (go-test) on project beam-sdks-go: Process exit code : 2 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :beam-sdks-go
STDERR:
2018-04-09 18:28:38,724 52a43360 MainThread beam_integration_benchmark(1/1) INFO Running benchmark beam_integration_benchmark
2018-04-09 18:28:38,732 52a43360 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/52a43360/beam/sdks/python/target>
2018-04-09 18:28:38,733 52a43360 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark
2018-04-09 18:28:38,735 52a43360 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark
Traceback (most recent call last):
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 758, in RunBenchmarkTask
RunBenchmark(spec, collector)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 624, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 527, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py",> line 159, in Run
job_type=job_type)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py",> line 87, in SubmitJob
self.spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 175, in BuildBeamCommand
cmd = _BuildPythonCommand(benchmark_spec, classname, job_arguments)
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 265, in _BuildPythonCommand
'apache-beam*.tar.gz')
File "<https://builds.apache.org/job/beam_PerformanceTests_Python/ws/PerfKitBenchmarker/perfkitbenchmarker/beam_benchmark_helper.py",> line 290, in _FindFiles
raise RuntimeError('No such directory: %s' % base_path)
RuntimeError: No such directory: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/52a43360/beam/sdks/python/target>
2018-04-09 18:28:38,736 52a43360 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue.
2018-04-09 18:28:38,752 52a43360 MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-04-09 18:28:38,752 52a43360 MainThread INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/52a43360/pkb.log>
2018-04-09 18:28:38,753 52a43360 MainThread INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_Python/ws/runs/52a43360/completion_statuses.json>
Build step 'Execute shell' marked build as failure
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user ehudm@google.com
Not sending mail to unregistered user rober@frantil.com
Not sending mail to unregistered user wtanaka@yahoo.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user dawid@getindata.com
Not sending mail to unregistered user pawel.pk.kaczmarczyk@gmail.com
Not sending mail to unregistered user fjetumale@gmail.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user xumingmingv@gmail.com
Not sending mail to unregistered user andreas.ehrencrona@velik.it
Not sending mail to unregistered user abhyankar@gmail.com
Not sending mail to unregistered user 1028332163@qq.com
Not sending mail to unregistered user mariand@google.com
Not sending mail to unregistered user alan.myrvold@comcast.net
Not sending mail to unregistered user arnaudfournier921@gmail.com
Not sending mail to unregistered user swegner2@gmail.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user luke_zhu@brown.edu
Not sending mail to unregistered user arostami@google.com
Not sending mail to unregistered user batbat@batbat-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user arnaudfournier021@gmail.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user robert@frantil.com
Not sending mail to unregistered user melissapa@google.com
Not sending mail to unregistered user holdenkarau@google.com
Not sending mail to unregistered user zoy@giggles.nyc.corp.google.com
Not sending mail to unregistered user samuel.waggoner@healthsparq.com
Not sending mail to unregistered user jiangkai@gmail.com
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user yifanzou@yifanzou-linuxworkstation.sea.corp.google.com
Not sending mail to unregistered user lukasz.gajowy@polidea.com
Not sending mail to unregistered user kedin@google.com
Not sending mail to unregistered user relax@relax-macbookpro2.roam.corp.google.com
Not sending mail to unregistered user ccy@google.com
Not sending mail to unregistered user klk@google.com
Not sending mail to unregistered user gene@telligent-data.com
Not sending mail to unregistered user cclauss@bluewin.ch
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user samuelw@google.com
Not sending mail to unregistered user dariusz.aniszewski@polidea.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user Mottyg1@gmail.com
Not sending mail to unregistered user willy@bounceexchange.com
Not sending mail to unregistered user aaltay@gmail.com
Not sending mail to unregistered user boyuanz@google.com
Not sending mail to unregistered user ekirpichov@gmail.com
Not sending mail to unregistered user zhouhai02@meituan.com
Not sending mail to unregistered user niemo@google.com
Not sending mail to unregistered user amyrvold@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user jb@nanthrax.net
Not sending mail to unregistered user sduskis@google.com
Not sending mail to unregistered user joey.baruch@gmail.com
Not sending mail to unregistered user XuMingmin@users.noreply.github.com
Not sending mail to unregistered user markliu@google.com
Not sending mail to unregistered user szewinho@gmail.com
Not sending mail to unregistered user dcavazos@google.com
Not sending mail to unregistered user grzegorz.kolakowski@getindata.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user aromanenko.dev@gmail.com