You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/07/13 00:27:37 UTC
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36 #10
See <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/10/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-10 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e6fa90a5dcc3b3aee805e185c3019213091463c0 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e6fa90a5dcc3b3aee805e185c3019213091463c0 # timeout=10
Commit message: "Merge pull request #12020: [BEAM-9066] Add javax.annotation-api dependency."
> git rev-list --no-walk e6fa90a5dcc3b3aee805e185c3019213091463c0 # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins849389324943306977.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins3216553408047463903.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins70052681026426791.sh
+ virtualenv <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env> --python=python2.7
New python executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python2.7>
Also creating executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins8493891097479247612.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.1.1)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.1.1)
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins8267117371740486256.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
Cloning into '<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins2895196524041424104.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt>
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing /home/jenkins/.cache/pip/wheels/b9/0a/0a/a99d0c1fe13d01efdf7aa29be87a4b1ac608072c150c669ba6/rsa-3.1.4-py2-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93/absl_py-0.9.0-py2-none-any.whl
Collecting jinja2>=2.7
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt> (line 17)) (44.1.1)
Collecting colorlog[windows]==2.6.0
Using cached colorlog-2.6.0-py2.py3-none-any.whl (11 kB)
Processing /home/jenkins/.cache/pip/wheels/7b/1f/a0/7ce496c69b9be7cef75645749e256d5ef2dc9d08336f92248b/blinker-1.4-py2-none-any.whl
Collecting futures>=3.0.3
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Processing /home/jenkins/.cache/pip/wheels/87/9b/a7/9bfdaa1487acce958269a6b5f86db2e4d38204dff4e256e23a/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl
Collecting pint>=0.7
Using cached Pint-0.9-py2.py3-none-any.whl (138 kB)
Collecting numpy==1.16.4
Using cached numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting contextlib2>=0.5.1
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Processing /home/jenkins/.cache/pip/wheels/2d/f7/d6/a43d1d088536280fca881232b9c352fa8c6be425d53e09d595/pywinrm-0.4.1-py2.py3-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/dc/f9/36/5ff60c0209ec9f77bce9aa535b7e570a87da8731ba6416db9d/timeout_decorator-0.4.1-py2-none-any.whl
Collecting google-cloud-datastore
Using cached google_cloud_datastore-1.13.0-py2.py3-none-any.whl (105 kB)
Collecting google-cloud-monitoring
Using cached google_cloud_monitoring-1.0.0-py2.py3-none-any.whl (235 kB)
Collecting pyasn1>=0.1.3
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting six
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting enum34; python_version < "3.4"
Using cached enum34-1.1.10-py2-none-any.whl (11 kB)
Collecting MarkupSafe>=0.23
Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Collecting colorama; extra == "windows"
Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting funcsigs; python_version == "2.7"
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting requests-ntlm>=0.3.0
Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting requests>=2.9.1
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting xmltodict
Using cached xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
Using cached google_api_core-1.21.0-py2.py3-none-any.whl (90 kB)
Collecting google-cloud-core<2.0dev,>=1.0.3
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting cryptography>=1.3
Using cached cryptography-2.9.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.7 MB)
Collecting ntlm-auth>=1.0.2
Using cached ntlm_auth-1.5.0-py2.py3-none-any.whl (29 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting google-auth<2.0dev,>=1.18.0
Using cached google_auth-1.18.0-py2.py3-none-any.whl (90 kB)
Collecting protobuf>=3.12.0
Using cached protobuf-3.12.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting pytz
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting grpcio<2.0dev,>=1.29.0; extra == "grpc"
Using cached grpcio-1.30.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB)
Collecting cffi!=1.11.3,>=1.8
Using cached cffi-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (387 kB)
Collecting ipaddress; python_version < "3"
Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Installing collected packages: pyasn1, rsa, six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, certifi, idna, chardet, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator, pyasn1-modules, cachetools, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-core, google-cloud-datastore, google-cloud-monitoring
Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2020.6.20 cffi-1.14.0 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.9.2 enum34-1.1.10 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.21.0 google-auth-1.18.0 google-cloud-core-1.3.0 google-cloud-datastore-1.13.0 google-cloud-monitoring-1.0.0 googleapis-common-protos-1.52.0 grpcio-1.30.0 idna-2.10 ipaddress-1.0.23 jinja2-2.11.2 ntlm-auth-1.5.0 numpy-1.16.4 pint-0.9 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pytz-2020.1 pywinrm-0.4.1 requests-2.24.0 requests-ntlm-1.1.0 rsa-3.1.4 six-1.15.0 timeout-decorator-0.4.1 urllib3-1.25.9 xmltodict-0.12.0
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins4371181771039766802.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python> <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py36_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/> --beam_location=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py36 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE'
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py",> line 19, in <module>
from perfkitbenchmarker.pkb import Main
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 76, in <module>
from perfkitbenchmarker import archive
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py",> line 24, in <module>
from perfkitbenchmarker.providers.aws.util import AWS_PATH
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py",> line 19, in <module>
from perfkitbenchmarker import events
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py",> line 26, in <module>
from perfkitbenchmarker import data
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py",> line 34, in <module>
from perfkitbenchmarker import temp_dir
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 29, in <module>
import functools32 as functools
ImportError: No module named functools32
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36 #18
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/18/display/redirect?page=changes>
Changes:
[Kenneth Knowles] [BEAM-10080] Fix PipelineOptions tests for Java 11 compat
[Kenneth Knowles] [BEAM-10080] Fix string match in ReflectHelpersTest for Java 11
[Udi Meiri] [BEAM-7014] filesystemio.py PipeStream rewind fix
[Kenneth Knowles] Only add test task in applyPythonNature if it does not already exist
[Kenneth Knowles] Add UsesTimersInParDo to test that was missing it
[Kenneth Knowles] Reduce Java portable ArtifactRetrieval chunk size to avoid breaking
[Kenneth Knowles] Add ability to specify stdout and stderr files for local_job_service;
[Kenneth Knowles] Create TestUniversalRunner for testing against Python ULR
[Kenneth Knowles] Add validatesRunner suite for local job service
[kcweaver] [BEAM-10460] Limit SparkPortableExecutionTest to a single thread.
[Kenneth Knowles] Exclude beam.* from license download since these are invalid artifact
[noreply] [BEAM-10420] Fix minor race condition related to splitting that will
[noreply] Merge pull request #12236 from [BEAM-10419] Ignore missing temporary
[noreply] Make tracking/cleanup of cache and in-environment states per pipeline
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-10 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 613edd392773f16c3411c75c821be8e78d867532 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 613edd392773f16c3411c75c821be8e78d867532 # timeout=10
Commit message: "Make tracking/cleanup of cache and in-environment states per pipeline (#12249)"
> git rev-list --no-walk 7a77912fa4cbdc3b25a806322c0461a2c054aaa3 # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins3433649267655929762.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins7495991981260030802.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins3262123177911168218.sh
+ virtualenv <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env> --python=python2.7
New python executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python2.7>
Also creating executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins7110509753400458736.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.1.1)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.1.1)
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins5624144621380491166.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
Cloning into '<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins6296037084690632027.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt>
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing /home/jenkins/.cache/pip/wheels/b9/0a/0a/a99d0c1fe13d01efdf7aa29be87a4b1ac608072c150c669ba6/rsa-3.1.4-py2-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93/absl_py-0.9.0-py2-none-any.whl
Collecting jinja2>=2.7
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt> (line 17)) (44.1.1)
Collecting colorlog[windows]==2.6.0
Using cached colorlog-2.6.0-py2.py3-none-any.whl (11 kB)
Processing /home/jenkins/.cache/pip/wheels/7b/1f/a0/7ce496c69b9be7cef75645749e256d5ef2dc9d08336f92248b/blinker-1.4-py2-none-any.whl
Collecting futures>=3.0.3
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Processing /home/jenkins/.cache/pip/wheels/87/9b/a7/9bfdaa1487acce958269a6b5f86db2e4d38204dff4e256e23a/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl
Collecting pint>=0.7
Using cached Pint-0.9-py2.py3-none-any.whl (138 kB)
Collecting numpy==1.16.4
Using cached numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting contextlib2>=0.5.1
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Processing /home/jenkins/.cache/pip/wheels/2d/f7/d6/a43d1d088536280fca881232b9c352fa8c6be425d53e09d595/pywinrm-0.4.1-py2.py3-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/dc/f9/36/5ff60c0209ec9f77bce9aa535b7e570a87da8731ba6416db9d/timeout_decorator-0.4.1-py2-none-any.whl
Collecting google-cloud-datastore
Using cached google_cloud_datastore-1.13.1-py2.py3-none-any.whl (131 kB)
Collecting google-cloud-monitoring
Using cached google_cloud_monitoring-1.0.0-py2.py3-none-any.whl (235 kB)
Collecting pyasn1>=0.1.3
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting six
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting enum34; python_version < "3.4"
Using cached enum34-1.1.10-py2-none-any.whl (11 kB)
Collecting MarkupSafe>=0.23
Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Collecting colorama; extra == "windows"
Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting funcsigs; python_version == "2.7"
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting requests-ntlm>=0.3.0
Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting requests>=2.9.1
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting xmltodict
Using cached xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
Using cached google_api_core-1.21.0-py2.py3-none-any.whl (90 kB)
Collecting google-cloud-core<2.0dev,>=1.0.3
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting cryptography>=1.3
Using cached cryptography-2.9.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.7 MB)
Collecting ntlm-auth>=1.0.2
Using cached ntlm_auth-1.5.0-py2.py3-none-any.whl (29 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting google-auth<2.0dev,>=1.18.0
Using cached google_auth-1.19.0-py2.py3-none-any.whl (91 kB)
Collecting protobuf>=3.12.0
Using cached protobuf-3.12.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting pytz
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting grpcio<2.0dev,>=1.29.0; extra == "grpc"
Using cached grpcio-1.30.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB)
Collecting cffi!=1.11.3,>=1.8
Using cached cffi-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (387 kB)
Collecting ipaddress; python_version < "3"
Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Installing collected packages: pyasn1, rsa, six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, certifi, idna, chardet, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator, pyasn1-modules, cachetools, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-core, google-cloud-datastore, google-cloud-monitoring
Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2020.6.20 cffi-1.14.0 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.9.2 enum34-1.1.10 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.21.0 google-auth-1.19.0 google-cloud-core-1.3.0 google-cloud-datastore-1.13.1 google-cloud-monitoring-1.0.0 googleapis-common-protos-1.52.0 grpcio-1.30.0 idna-2.10 ipaddress-1.0.23 jinja2-2.11.2 ntlm-auth-1.5.0 numpy-1.16.4 pint-0.9 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pytz-2020.1 pywinrm-0.4.1 requests-2.24.0 requests-ntlm-1.1.0 rsa-3.1.4 six-1.15.0 timeout-decorator-0.4.1 urllib3-1.25.9 xmltodict-0.12.0
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins1818693949098847534.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python> <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py36_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/> --beam_location=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py36 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE'
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py",> line 19, in <module>
from perfkitbenchmarker.pkb import Main
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 76, in <module>
from perfkitbenchmarker import archive
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py",> line 24, in <module>
from perfkitbenchmarker.providers.aws.util import AWS_PATH
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py",> line 19, in <module>
from perfkitbenchmarker import events
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py",> line 26, in <module>
from perfkitbenchmarker import data
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py",> line 34, in <module>
from perfkitbenchmarker import temp_dir
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 29, in <module>
import functools32 as functools
ImportError: No module named functools32
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36 #17
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/17/display/redirect?page=changes>
Changes:
[tobiasz.kedzierski] Add checksums
[Robert Bradshaw] DoFnTester is deprecated and should not be recommended.
[noreply] Merge pull request #12201 from [BEAM-10291] log full thread dump only
[Robert Bradshaw] Add Python snippets in testing guide.
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-10 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 7a77912fa4cbdc3b25a806322c0461a2c054aaa3 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 7a77912fa4cbdc3b25a806322c0461a2c054aaa3 # timeout=10
Commit message: "Merge pull request #12246 Add Python snippets in testing guide."
> git rev-list --no-walk 10a1bbb557ee15d83c530a0436bb823a9686d131 # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins8360034426937326926.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins7237088021698996257.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins5048107284598151080.sh
+ virtualenv <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env> --python=python2.7
New python executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python2.7>
Also creating executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins274560868791470515.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.1.1)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.1.1)
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins7930790388392419556.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
Cloning into '<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins8271614550332070059.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt>
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing /home/jenkins/.cache/pip/wheels/b9/0a/0a/a99d0c1fe13d01efdf7aa29be87a4b1ac608072c150c669ba6/rsa-3.1.4-py2-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93/absl_py-0.9.0-py2-none-any.whl
Collecting jinja2>=2.7
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt> (line 17)) (44.1.1)
Collecting colorlog[windows]==2.6.0
Using cached colorlog-2.6.0-py2.py3-none-any.whl (11 kB)
Processing /home/jenkins/.cache/pip/wheels/7b/1f/a0/7ce496c69b9be7cef75645749e256d5ef2dc9d08336f92248b/blinker-1.4-py2-none-any.whl
Collecting futures>=3.0.3
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Processing /home/jenkins/.cache/pip/wheels/87/9b/a7/9bfdaa1487acce958269a6b5f86db2e4d38204dff4e256e23a/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl
Collecting pint>=0.7
Using cached Pint-0.9-py2.py3-none-any.whl (138 kB)
Collecting numpy==1.16.4
Using cached numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting contextlib2>=0.5.1
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Processing /home/jenkins/.cache/pip/wheels/2d/f7/d6/a43d1d088536280fca881232b9c352fa8c6be425d53e09d595/pywinrm-0.4.1-py2.py3-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/dc/f9/36/5ff60c0209ec9f77bce9aa535b7e570a87da8731ba6416db9d/timeout_decorator-0.4.1-py2-none-any.whl
Collecting google-cloud-datastore
Downloading google_cloud_datastore-1.13.1-py2.py3-none-any.whl (131 kB)
Collecting google-cloud-monitoring
Using cached google_cloud_monitoring-1.0.0-py2.py3-none-any.whl (235 kB)
Collecting pyasn1>=0.1.3
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting six
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting enum34; python_version < "3.4"
Using cached enum34-1.1.10-py2-none-any.whl (11 kB)
Collecting MarkupSafe>=0.23
Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Collecting colorama; extra == "windows"
Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting funcsigs; python_version == "2.7"
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting requests-ntlm>=0.3.0
Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting requests>=2.9.1
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting xmltodict
Using cached xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
Using cached google_api_core-1.21.0-py2.py3-none-any.whl (90 kB)
Collecting google-cloud-core<2.0dev,>=1.0.3
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting cryptography>=1.3
Using cached cryptography-2.9.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.7 MB)
Collecting ntlm-auth>=1.0.2
Using cached ntlm_auth-1.5.0-py2.py3-none-any.whl (29 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting google-auth<2.0dev,>=1.18.0
Using cached google_auth-1.19.0-py2.py3-none-any.whl (91 kB)
Collecting protobuf>=3.12.0
Using cached protobuf-3.12.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting pytz
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting grpcio<2.0dev,>=1.29.0; extra == "grpc"
Using cached grpcio-1.30.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB)
Collecting cffi!=1.11.3,>=1.8
Using cached cffi-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (387 kB)
Collecting ipaddress; python_version < "3"
Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Installing collected packages: pyasn1, rsa, six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, certifi, idna, chardet, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator, pyasn1-modules, cachetools, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-core, google-cloud-datastore, google-cloud-monitoring
Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2020.6.20 cffi-1.14.0 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.9.2 enum34-1.1.10 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.21.0 google-auth-1.19.0 google-cloud-core-1.3.0 google-cloud-datastore-1.13.1 google-cloud-monitoring-1.0.0 googleapis-common-protos-1.52.0 grpcio-1.30.0 idna-2.10 ipaddress-1.0.23 jinja2-2.11.2 ntlm-auth-1.5.0 numpy-1.16.4 pint-0.9 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pytz-2020.1 pywinrm-0.4.1 requests-2.24.0 requests-ntlm-1.1.0 rsa-3.1.4 six-1.15.0 timeout-decorator-0.4.1 urllib3-1.25.9 xmltodict-0.12.0
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins4259845514661213906.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python> <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py36_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/> --beam_location=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py36 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE'
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py",> line 19, in <module>
from perfkitbenchmarker.pkb import Main
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 76, in <module>
from perfkitbenchmarker import archive
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py",> line 24, in <module>
from perfkitbenchmarker.providers.aws.util import AWS_PATH
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py",> line 19, in <module>
from perfkitbenchmarker import events
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py",> line 26, in <module>
from perfkitbenchmarker import data
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py",> line 34, in <module>
from perfkitbenchmarker import temp_dir
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 29, in <module>
import functools32 as functools
ImportError: No module named functools32
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36 #16
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/16/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-5 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 10a1bbb557ee15d83c530a0436bb823a9686d131 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 10a1bbb557ee15d83c530a0436bb823a9686d131 # timeout=10
Commit message: "Merge pull request #12238: [BEAM-4709] Adding PostCommit jenkins job that builds Javadoc"
> git rev-list --no-walk 10a1bbb557ee15d83c530a0436bb823a9686d131 # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins2302059494712615248.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins5826498674389307302.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins2559746078409843114.sh
+ virtualenv <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env> --python=python2.7
New python executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python2.7>
Also creating executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins6338188243394935153.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.1.1)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.1.1)
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins2168979355137282135.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
Cloning into '<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins9072351516421319726.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt>
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing /home/jenkins/.cache/pip/wheels/b9/0a/0a/a99d0c1fe13d01efdf7aa29be87a4b1ac608072c150c669ba6/rsa-3.1.4-py2-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93/absl_py-0.9.0-py2-none-any.whl
Collecting jinja2>=2.7
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt> (line 17)) (44.1.1)
Collecting colorlog[windows]==2.6.0
Using cached colorlog-2.6.0-py2.py3-none-any.whl (11 kB)
Processing /home/jenkins/.cache/pip/wheels/7b/1f/a0/7ce496c69b9be7cef75645749e256d5ef2dc9d08336f92248b/blinker-1.4-py2-none-any.whl
Collecting futures>=3.0.3
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Processing /home/jenkins/.cache/pip/wheels/87/9b/a7/9bfdaa1487acce958269a6b5f86db2e4d38204dff4e256e23a/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl
Collecting pint>=0.7
Using cached Pint-0.9-py2.py3-none-any.whl (138 kB)
Collecting numpy==1.16.4
Using cached numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting contextlib2>=0.5.1
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Processing /home/jenkins/.cache/pip/wheels/2d/f7/d6/a43d1d088536280fca881232b9c352fa8c6be425d53e09d595/pywinrm-0.4.1-py2.py3-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/dc/f9/36/5ff60c0209ec9f77bce9aa535b7e570a87da8731ba6416db9d/timeout_decorator-0.4.1-py2-none-any.whl
Collecting google-cloud-datastore
Downloading google_cloud_datastore-1.13.1-py2.py3-none-any.whl (131 kB)
Collecting google-cloud-monitoring
Using cached google_cloud_monitoring-1.0.0-py2.py3-none-any.whl (235 kB)
Collecting pyasn1>=0.1.3
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting six
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting enum34; python_version < "3.4"
Using cached enum34-1.1.10-py2-none-any.whl (11 kB)
Collecting MarkupSafe>=0.23
Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Collecting colorama; extra == "windows"
Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting funcsigs; python_version == "2.7"
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting requests-ntlm>=0.3.0
Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting requests>=2.9.1
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting xmltodict
Using cached xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
Using cached google_api_core-1.21.0-py2.py3-none-any.whl (90 kB)
Collecting google-cloud-core<2.0dev,>=1.0.3
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting cryptography>=1.3
Using cached cryptography-2.9.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.7 MB)
Collecting ntlm-auth>=1.0.2
Using cached ntlm_auth-1.5.0-py2.py3-none-any.whl (29 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting google-auth<2.0dev,>=1.18.0
Using cached google_auth-1.19.0-py2.py3-none-any.whl (91 kB)
Collecting protobuf>=3.12.0
Using cached protobuf-3.12.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting pytz
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting grpcio<2.0dev,>=1.29.0; extra == "grpc"
Using cached grpcio-1.30.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB)
Collecting cffi!=1.11.3,>=1.8
Using cached cffi-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (387 kB)
Collecting ipaddress; python_version < "3"
Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Installing collected packages: pyasn1, rsa, six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, certifi, idna, chardet, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator, pyasn1-modules, cachetools, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-core, google-cloud-datastore, google-cloud-monitoring
Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2020.6.20 cffi-1.14.0 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.9.2 enum34-1.1.10 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.21.0 google-auth-1.19.0 google-cloud-core-1.3.0 google-cloud-datastore-1.13.1 google-cloud-monitoring-1.0.0 googleapis-common-protos-1.52.0 grpcio-1.30.0 idna-2.10 ipaddress-1.0.23 jinja2-2.11.2 ntlm-auth-1.5.0 numpy-1.16.4 pint-0.9 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pytz-2020.1 pywinrm-0.4.1 requests-2.24.0 requests-ntlm-1.1.0 rsa-3.1.4 six-1.15.0 timeout-decorator-0.4.1 urllib3-1.25.9 xmltodict-0.12.0
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins6516260193067765656.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python> <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py36_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/> --beam_location=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py36 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE'
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py",> line 19, in <module>
from perfkitbenchmarker.pkb import Main
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 76, in <module>
from perfkitbenchmarker import archive
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py",> line 24, in <module>
from perfkitbenchmarker.providers.aws.util import AWS_PATH
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py",> line 19, in <module>
from perfkitbenchmarker import events
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py",> line 26, in <module>
from perfkitbenchmarker import data
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py",> line 34, in <module>
from perfkitbenchmarker import temp_dir
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 29, in <module>
import functools32 as functools
ImportError: No module named functools32
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36 #15
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/15/display/redirect?page=changes>
Changes:
[Damian Gadomski] Adding precommit job that builds javadoc
[Damian Gadomski] Adding issues recording for javadoc CI job
[Damian Gadomski] changeing Javadoc PreCommit to PostCommit job
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-7 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 10a1bbb557ee15d83c530a0436bb823a9686d131 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 10a1bbb557ee15d83c530a0436bb823a9686d131 # timeout=10
Commit message: "Merge pull request #12238: [BEAM-4709] Adding PostCommit jenkins job that builds Javadoc"
> git rev-list --no-walk 0d05e410258408a26f17c476f69ba57b2843d35c # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins146253157866004103.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins1262350096618701743.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins4834964274187680525.sh
+ virtualenv <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env> --python=python2.7
New python executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python2.7>
Also creating executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins2694651102463418440.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.1.1)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.1.1)
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins7076434005412602923.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
Cloning into '<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins7677345599798450782.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt>
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing /home/jenkins/.cache/pip/wheels/b9/0a/0a/a99d0c1fe13d01efdf7aa29be87a4b1ac608072c150c669ba6/rsa-3.1.4-py2-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93/absl_py-0.9.0-py2-none-any.whl
Collecting jinja2>=2.7
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt> (line 17)) (44.1.1)
Collecting colorlog[windows]==2.6.0
Using cached colorlog-2.6.0-py2.py3-none-any.whl (11 kB)
Processing /home/jenkins/.cache/pip/wheels/7b/1f/a0/7ce496c69b9be7cef75645749e256d5ef2dc9d08336f92248b/blinker-1.4-py2-none-any.whl
Collecting futures>=3.0.3
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Processing /home/jenkins/.cache/pip/wheels/87/9b/a7/9bfdaa1487acce958269a6b5f86db2e4d38204dff4e256e23a/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl
Collecting pint>=0.7
Using cached Pint-0.9-py2.py3-none-any.whl (138 kB)
Collecting numpy==1.16.4
Using cached numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting contextlib2>=0.5.1
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Processing /home/jenkins/.cache/pip/wheels/2d/f7/d6/a43d1d088536280fca881232b9c352fa8c6be425d53e09d595/pywinrm-0.4.1-py2.py3-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/dc/f9/36/5ff60c0209ec9f77bce9aa535b7e570a87da8731ba6416db9d/timeout_decorator-0.4.1-py2-none-any.whl
Collecting google-cloud-datastore
Downloading google_cloud_datastore-1.13.1-py2.py3-none-any.whl (131 kB)
Collecting google-cloud-monitoring
Using cached google_cloud_monitoring-1.0.0-py2.py3-none-any.whl (235 kB)
Collecting pyasn1>=0.1.3
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting six
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting enum34; python_version < "3.4"
Using cached enum34-1.1.10-py2-none-any.whl (11 kB)
Collecting MarkupSafe>=0.23
Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Collecting colorama; extra == "windows"
Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting funcsigs; python_version == "2.7"
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting requests-ntlm>=0.3.0
Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting requests>=2.9.1
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting xmltodict
Using cached xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
Using cached google_api_core-1.21.0-py2.py3-none-any.whl (90 kB)
Collecting google-cloud-core<2.0dev,>=1.0.3
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting cryptography>=1.3
Using cached cryptography-2.9.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.7 MB)
Collecting ntlm-auth>=1.0.2
Using cached ntlm_auth-1.5.0-py2.py3-none-any.whl (29 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting google-auth<2.0dev,>=1.18.0
Using cached google_auth-1.19.0-py2.py3-none-any.whl (91 kB)
Collecting protobuf>=3.12.0
Using cached protobuf-3.12.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting pytz
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting grpcio<2.0dev,>=1.29.0; extra == "grpc"
Using cached grpcio-1.30.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB)
Collecting cffi!=1.11.3,>=1.8
Using cached cffi-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (387 kB)
Collecting ipaddress; python_version < "3"
Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Installing collected packages: pyasn1, rsa, six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, certifi, idna, chardet, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator, pyasn1-modules, cachetools, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-core, google-cloud-datastore, google-cloud-monitoring
Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2020.6.20 cffi-1.14.0 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.9.2 enum34-1.1.10 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.21.0 google-auth-1.19.0 google-cloud-core-1.3.0 google-cloud-datastore-1.13.1 google-cloud-monitoring-1.0.0 googleapis-common-protos-1.52.0 grpcio-1.30.0 idna-2.10 ipaddress-1.0.23 jinja2-2.11.2 ntlm-auth-1.5.0 numpy-1.16.4 pint-0.9 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pytz-2020.1 pywinrm-0.4.1 requests-2.24.0 requests-ntlm-1.1.0 rsa-3.1.4 six-1.15.0 timeout-decorator-0.4.1 urllib3-1.25.9 xmltodict-0.12.0
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins7420180794594289952.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python> <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py36_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/> --beam_location=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py36 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE'
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py",> line 19, in <module>
from perfkitbenchmarker.pkb import Main
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 76, in <module>
from perfkitbenchmarker import archive
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py",> line 24, in <module>
from perfkitbenchmarker.providers.aws.util import AWS_PATH
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py",> line 19, in <module>
from perfkitbenchmarker import events
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py",> line 26, in <module>
from perfkitbenchmarker import data
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py",> line 34, in <module>
from perfkitbenchmarker import temp_dir
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 29, in <module>
import functools32 as functools
ImportError: No module named functools32
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36 #14
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/14/display/redirect?page=changes>
Changes:
[none] Copy Pub/Sub Lite IO from Pub/Sub Lite github to beam.
[none] Restructure IO to expose proto types instead of client library wrapper
[Kenneth Knowles] Migrate ApiSurface back to recent Guava
[Kenneth Knowles] Exclude jdk.internal.HotSpotIntrinsicCandidate from ApiSurface
[Kenneth Knowles] Fix deps for Java container license report
[Kenneth Knowles] Re-enable checker in Samza job server
[Kenneth Knowles] [BEAM-10080] Fix LocalFileSystemsTest to work with Java 11
[noreply] [BEAM-10407] Revamped SchemaCapableIOProvider interface to
[noreply] [BEAM-9178] Support more EXTRACT functions (#12231)
[heejong] add direct runner xlang test badge
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-10 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 0d05e410258408a26f17c476f69ba57b2843d35c (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 0d05e410258408a26f17c476f69ba57b2843d35c # timeout=10
Commit message: "Merge pull request #12244 from ihji/add_fnapi_xlang_badge"
> git rev-list --no-walk 66bcc9a967746cad12dfdeed473fb60c77033514 # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins6108449226301842386.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins5231181678426678340.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins5884294499275569179.sh
+ virtualenv <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env> --python=python2.7
New python executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python2.7>
Also creating executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins4827448757252084773.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.1.1)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.1.1)
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins7111088127135921671.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
Cloning into '<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins3110266222673166613.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt>
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing /home/jenkins/.cache/pip/wheels/b9/0a/0a/a99d0c1fe13d01efdf7aa29be87a4b1ac608072c150c669ba6/rsa-3.1.4-py2-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93/absl_py-0.9.0-py2-none-any.whl
Collecting jinja2>=2.7
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt> (line 17)) (44.1.1)
Collecting colorlog[windows]==2.6.0
Using cached colorlog-2.6.0-py2.py3-none-any.whl (11 kB)
Processing /home/jenkins/.cache/pip/wheels/7b/1f/a0/7ce496c69b9be7cef75645749e256d5ef2dc9d08336f92248b/blinker-1.4-py2-none-any.whl
Collecting futures>=3.0.3
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Processing /home/jenkins/.cache/pip/wheels/87/9b/a7/9bfdaa1487acce958269a6b5f86db2e4d38204dff4e256e23a/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl
Collecting pint>=0.7
Using cached Pint-0.9-py2.py3-none-any.whl (138 kB)
Collecting numpy==1.16.4
Using cached numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting contextlib2>=0.5.1
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Processing /home/jenkins/.cache/pip/wheels/2d/f7/d6/a43d1d088536280fca881232b9c352fa8c6be425d53e09d595/pywinrm-0.4.1-py2.py3-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/dc/f9/36/5ff60c0209ec9f77bce9aa535b7e570a87da8731ba6416db9d/timeout_decorator-0.4.1-py2-none-any.whl
Collecting google-cloud-datastore
Using cached google_cloud_datastore-1.13.0-py2.py3-none-any.whl (105 kB)
Collecting google-cloud-monitoring
Using cached google_cloud_monitoring-1.0.0-py2.py3-none-any.whl (235 kB)
Collecting pyasn1>=0.1.3
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting six
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting enum34; python_version < "3.4"
Using cached enum34-1.1.10-py2-none-any.whl (11 kB)
Collecting MarkupSafe>=0.23
Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Collecting colorama; extra == "windows"
Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting funcsigs; python_version == "2.7"
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting requests-ntlm>=0.3.0
Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting requests>=2.9.1
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting xmltodict
Using cached xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
Using cached google_api_core-1.21.0-py2.py3-none-any.whl (90 kB)
Collecting google-cloud-core<2.0dev,>=1.0.3
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting cryptography>=1.3
Using cached cryptography-2.9.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.7 MB)
Collecting ntlm-auth>=1.0.2
Using cached ntlm_auth-1.5.0-py2.py3-none-any.whl (29 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting google-auth<2.0dev,>=1.18.0
Using cached google_auth-1.19.0-py2.py3-none-any.whl (91 kB)
Collecting protobuf>=3.12.0
Using cached protobuf-3.12.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting pytz
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting grpcio<2.0dev,>=1.29.0; extra == "grpc"
Using cached grpcio-1.30.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB)
Collecting cffi!=1.11.3,>=1.8
Using cached cffi-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (387 kB)
Collecting ipaddress; python_version < "3"
Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Installing collected packages: pyasn1, rsa, six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, certifi, idna, chardet, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator, pyasn1-modules, cachetools, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-core, google-cloud-datastore, google-cloud-monitoring
Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2020.6.20 cffi-1.14.0 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.9.2 enum34-1.1.10 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.21.0 google-auth-1.19.0 google-cloud-core-1.3.0 google-cloud-datastore-1.13.0 google-cloud-monitoring-1.0.0 googleapis-common-protos-1.52.0 grpcio-1.30.0 idna-2.10 ipaddress-1.0.23 jinja2-2.11.2 ntlm-auth-1.5.0 numpy-1.16.4 pint-0.9 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pytz-2020.1 pywinrm-0.4.1 requests-2.24.0 requests-ntlm-1.1.0 rsa-3.1.4 six-1.15.0 timeout-decorator-0.4.1 urllib3-1.25.9 xmltodict-0.12.0
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins3344523302548419787.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python> <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py36_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/> --beam_location=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py36 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE'
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py",> line 19, in <module>
from perfkitbenchmarker.pkb import Main
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 76, in <module>
from perfkitbenchmarker import archive
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py",> line 24, in <module>
from perfkitbenchmarker.providers.aws.util import AWS_PATH
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py",> line 19, in <module>
from perfkitbenchmarker import events
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py",> line 26, in <module>
from perfkitbenchmarker import data
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py",> line 34, in <module>
from perfkitbenchmarker import temp_dir
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 29, in <module>
import functools32 as functools
ImportError: No module named functools32
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36 #13
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/13/display/redirect?page=changes>
Changes:
[noreply] [BEAM-10455] Provide an example of how to memoize the DataSource
[noreply] [BEAM-10450] [BEAM-10449] Fix empty flatten bundle processing. (#12226)
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-10 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 66bcc9a967746cad12dfdeed473fb60c77033514 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 66bcc9a967746cad12dfdeed473fb60c77033514 # timeout=10
Commit message: "[BEAM-10450] [BEAM-10449] Fix empty flatten bundle processing. (#12226)"
> git rev-list --no-walk e6fa90a5dcc3b3aee805e185c3019213091463c0 # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins292717044583048391.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins2244401025573463505.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins3696107305039035233.sh
+ virtualenv <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env> --python=python2.7
New python executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python2.7>
Also creating executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins268734318772399096.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.1.1)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.1.1)
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins1943383452554123409.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
Cloning into '<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins5732576250154054794.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt>
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing /home/jenkins/.cache/pip/wheels/b9/0a/0a/a99d0c1fe13d01efdf7aa29be87a4b1ac608072c150c669ba6/rsa-3.1.4-py2-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93/absl_py-0.9.0-py2-none-any.whl
Collecting jinja2>=2.7
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt> (line 17)) (44.1.1)
Collecting colorlog[windows]==2.6.0
Using cached colorlog-2.6.0-py2.py3-none-any.whl (11 kB)
Processing /home/jenkins/.cache/pip/wheels/7b/1f/a0/7ce496c69b9be7cef75645749e256d5ef2dc9d08336f92248b/blinker-1.4-py2-none-any.whl
Collecting futures>=3.0.3
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Processing /home/jenkins/.cache/pip/wheels/87/9b/a7/9bfdaa1487acce958269a6b5f86db2e4d38204dff4e256e23a/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl
Collecting pint>=0.7
Using cached Pint-0.9-py2.py3-none-any.whl (138 kB)
Collecting numpy==1.16.4
Using cached numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting contextlib2>=0.5.1
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Processing /home/jenkins/.cache/pip/wheels/2d/f7/d6/a43d1d088536280fca881232b9c352fa8c6be425d53e09d595/pywinrm-0.4.1-py2.py3-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/dc/f9/36/5ff60c0209ec9f77bce9aa535b7e570a87da8731ba6416db9d/timeout_decorator-0.4.1-py2-none-any.whl
Collecting google-cloud-datastore
Using cached google_cloud_datastore-1.13.0-py2.py3-none-any.whl (105 kB)
Collecting google-cloud-monitoring
Using cached google_cloud_monitoring-1.0.0-py2.py3-none-any.whl (235 kB)
Collecting pyasn1>=0.1.3
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting six
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting enum34; python_version < "3.4"
Using cached enum34-1.1.10-py2-none-any.whl (11 kB)
Collecting MarkupSafe>=0.23
Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Collecting colorama; extra == "windows"
Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting funcsigs; python_version == "2.7"
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting requests-ntlm>=0.3.0
Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting requests>=2.9.1
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting xmltodict
Using cached xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
Using cached google_api_core-1.21.0-py2.py3-none-any.whl (90 kB)
Collecting google-cloud-core<2.0dev,>=1.0.3
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting cryptography>=1.3
Using cached cryptography-2.9.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.7 MB)
Collecting ntlm-auth>=1.0.2
Using cached ntlm_auth-1.5.0-py2.py3-none-any.whl (29 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting google-auth<2.0dev,>=1.18.0
Using cached google_auth-1.18.0-py2.py3-none-any.whl (90 kB)
Collecting protobuf>=3.12.0
Using cached protobuf-3.12.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting pytz
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting grpcio<2.0dev,>=1.29.0; extra == "grpc"
Using cached grpcio-1.30.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB)
Collecting cffi!=1.11.3,>=1.8
Using cached cffi-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (387 kB)
Collecting ipaddress; python_version < "3"
Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Installing collected packages: pyasn1, rsa, six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, certifi, idna, chardet, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator, pyasn1-modules, cachetools, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-core, google-cloud-datastore, google-cloud-monitoring
Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2020.6.20 cffi-1.14.0 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.9.2 enum34-1.1.10 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.21.0 google-auth-1.18.0 google-cloud-core-1.3.0 google-cloud-datastore-1.13.0 google-cloud-monitoring-1.0.0 googleapis-common-protos-1.52.0 grpcio-1.30.0 idna-2.10 ipaddress-1.0.23 jinja2-2.11.2 ntlm-auth-1.5.0 numpy-1.16.4 pint-0.9 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pytz-2020.1 pywinrm-0.4.1 requests-2.24.0 requests-ntlm-1.1.0 rsa-3.1.4 six-1.15.0 timeout-decorator-0.4.1 urllib3-1.25.9 xmltodict-0.12.0
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins8845963359407015751.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python> <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py36_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/> --beam_location=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py36 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE'
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py",> line 19, in <module>
from perfkitbenchmarker.pkb import Main
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 76, in <module>
from perfkitbenchmarker import archive
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py",> line 24, in <module>
from perfkitbenchmarker.providers.aws.util import AWS_PATH
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py",> line 19, in <module>
from perfkitbenchmarker import events
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py",> line 26, in <module>
from perfkitbenchmarker import data
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py",> line 34, in <module>
from perfkitbenchmarker import temp_dir
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 29, in <module>
import functools32 as functools
ImportError: No module named functools32
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36 #12
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/12/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-9 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e6fa90a5dcc3b3aee805e185c3019213091463c0 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e6fa90a5dcc3b3aee805e185c3019213091463c0 # timeout=10
Commit message: "Merge pull request #12020: [BEAM-9066] Add javax.annotation-api dependency."
> git rev-list --no-walk e6fa90a5dcc3b3aee805e185c3019213091463c0 # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins930744491868861725.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins4433052332658025431.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins3626271001223231112.sh
+ virtualenv <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env> --python=python2.7
New python executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python2.7>
Also creating executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins4937963615178365526.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.1.1)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.1.1)
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins954030447886715072.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
Cloning into '<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins5253243432706762636.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt>
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Collecting rsa==3.1.4
Downloading rsa-3.1.4.tar.gz (36 kB)
Collecting absl-py
Downloading absl-py-0.9.0.tar.gz (104 kB)
Collecting jinja2>=2.7
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt> (line 17)) (44.1.1)
Collecting colorlog[windows]==2.6.0
Downloading colorlog-2.6.0-py2.py3-none-any.whl (11 kB)
Collecting blinker>=1.3
Downloading blinker-1.4.tar.gz (111 kB)
Collecting futures>=3.0.3
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Collecting PyYAML==5.1.2
Downloading PyYAML-5.1.2.tar.gz (265 kB)
Collecting pint>=0.7
Downloading Pint-0.9-py2.py3-none-any.whl (138 kB)
Collecting numpy==1.16.4
Downloading numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting contextlib2>=0.5.1
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Collecting pywinrm
Downloading pywinrm-0.4.1.tar.gz (36 kB)
Collecting timeout-decorator
Downloading timeout-decorator-0.4.1.tar.gz (4.8 kB)
Collecting google-cloud-datastore
Downloading google_cloud_datastore-1.13.0-py2.py3-none-any.whl (105 kB)
Collecting google-cloud-monitoring
Downloading google_cloud_monitoring-1.0.0-py2.py3-none-any.whl (235 kB)
Collecting pyasn1>=0.1.3
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting six
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting enum34
Using cached enum34-1.1.10-py2-none-any.whl (11 kB)
Collecting MarkupSafe>=0.23
Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Collecting colorama; extra == "windows"
Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting funcsigs; python_version == "2.7"
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting xmltodict
Downloading xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB)
Collecting requests>=2.9.1
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting requests_ntlm>=0.3.0
Downloading requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
Using cached google_api_core-1.21.0-py2.py3-none-any.whl (90 kB)
Collecting google-cloud-core<2.0dev,>=1.0.3
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting cryptography>=1.3
Downloading cryptography-2.9.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.7 MB)
Collecting ntlm-auth>=1.0.2
Downloading ntlm_auth-1.5.0-py2.py3-none-any.whl (29 kB)
Collecting google-auth<2.0dev,>=1.18.0
Using cached google_auth-1.18.0-py2.py3-none-any.whl (90 kB)
Collecting protobuf>=3.12.0
Using cached protobuf-3.12.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting pytz
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting grpcio<2.0dev,>=1.29.0; extra == "grpc"
Using cached grpcio-1.30.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB)
Collecting cffi!=1.11.3,>=1.8
Downloading cffi-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (387 kB)
Collecting ipaddress; python_version < "3"
Downloading ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting pycparser
Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Building wheels for collected packages: rsa, absl-py, blinker, PyYAML, pywinrm, timeout-decorator
Building wheel for rsa (setup.py): started
Building wheel for rsa (setup.py): finished with status 'done'
Created wheel for rsa: filename=rsa-3.1.4-py2-none-any.whl size=43339 sha256=819f0c2d364504539b5783f63b224fb1f0bb442895d2dcb5c39811433eccb7cf
Stored in directory: /home/jenkins/.cache/pip/wheels/b9/0a/0a/a99d0c1fe13d01efdf7aa29be87a4b1ac608072c150c669ba6
Building wheel for absl-py (setup.py): started
Building wheel for absl-py (setup.py): finished with status 'done'
Created wheel for absl-py: filename=absl_py-0.9.0-py2-none-any.whl size=121931 sha256=204f1adad60c3d2763889ef894ffc9a8cd88d79f4e63ab8358a7f1cd2a59da9f
Stored in directory: /home/jenkins/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93
Building wheel for blinker (setup.py): started
Building wheel for blinker (setup.py): finished with status 'done'
Created wheel for blinker: filename=blinker-1.4-py2-none-any.whl size=13451 sha256=f66bbccdf0d79a4cb7fef97a439efd0a766a2f8359b801a0dc25f9b00a939964
Stored in directory: /home/jenkins/.cache/pip/wheels/7b/1f/a0/7ce496c69b9be7cef75645749e256d5ef2dc9d08336f92248b
Building wheel for PyYAML (setup.py): started
Building wheel for PyYAML (setup.py): finished with status 'done'
Created wheel for PyYAML: filename=PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl size=44911 sha256=a8e439f9f90ac861dc65a4231ceabac1e0269688f061d9118e2f103d0becc970
Stored in directory: /home/jenkins/.cache/pip/wheels/87/9b/a7/9bfdaa1487acce958269a6b5f86db2e4d38204dff4e256e23a
Building wheel for pywinrm (setup.py): started
Building wheel for pywinrm (setup.py): finished with status 'done'
Created wheel for pywinrm: filename=pywinrm-0.4.1-py2.py3-none-any.whl size=40451 sha256=81c9f797c510e987b13fac2d22ba5ebb2c319ce278742a35673bdaa98e897df6
Stored in directory: /home/jenkins/.cache/pip/wheels/2d/f7/d6/a43d1d088536280fca881232b9c352fa8c6be425d53e09d595
Building wheel for timeout-decorator (setup.py): started
Building wheel for timeout-decorator (setup.py): finished with status 'done'
Created wheel for timeout-decorator: filename=timeout_decorator-0.4.1-py2-none-any.whl size=5015 sha256=f9a426f1dbf7f81669830611b5942a89766128665c6d1be7e5450a0a322bad5f
Stored in directory: /home/jenkins/.cache/pip/wheels/dc/f9/36/5ff60c0209ec9f77bce9aa535b7e570a87da8731ba6416db9d
Successfully built rsa absl-py blinker PyYAML pywinrm timeout-decorator
Installing collected packages: pyasn1, rsa, six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, xmltodict, certifi, idna, chardet, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, pywinrm, timeout-decorator, pyasn1-modules, cachetools, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-core, google-cloud-datastore, google-cloud-monitoring
Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2020.6.20 cffi-1.14.0 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.9.2 enum34-1.1.10 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.21.0 google-auth-1.18.0 google-cloud-core-1.3.0 google-cloud-datastore-1.13.0 google-cloud-monitoring-1.0.0 googleapis-common-protos-1.52.0 grpcio-1.30.0 idna-2.10 ipaddress-1.0.23 jinja2-2.11.2 ntlm-auth-1.5.0 numpy-1.16.4 pint-0.9 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pytz-2020.1 pywinrm-0.4.1 requests-2.24.0 requests-ntlm-1.1.0 rsa-3.1.4 six-1.15.0 timeout-decorator-0.4.1 urllib3-1.25.9 xmltodict-0.12.0
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins7983628432030011815.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python> <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py36_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/> --beam_location=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py36 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE'
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py",> line 19, in <module>
from perfkitbenchmarker.pkb import Main
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 76, in <module>
from perfkitbenchmarker import archive
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py",> line 24, in <module>
from perfkitbenchmarker.providers.aws.util import AWS_PATH
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py",> line 19, in <module>
from perfkitbenchmarker import events
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py",> line 26, in <module>
from perfkitbenchmarker import data
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py",> line 34, in <module>
from perfkitbenchmarker import temp_dir
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 29, in <module>
import functools32 as functools
ImportError: No module named functools32
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py36 #11
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/11/display/redirect>
Changes:
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-7 (beam) in workspace <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
> git init <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git --version # timeout=10
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
> git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
> git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
> git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # timeout=10
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision e6fa90a5dcc3b3aee805e185c3019213091463c0 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f e6fa90a5dcc3b3aee805e185c3019213091463c0 # timeout=10
Commit message: "Merge pull request #12020: [BEAM-9066] Add javax.annotation-api dependency."
> git rev-list --no-walk e6fa90a5dcc3b3aee805e185c3019213091463c0 # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content
SPARK_LOCAL_IP=127.0.0.1
[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins3506180927971127517.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins1838039811585863543.sh
+ rm -rf <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins6270929007523735482.sh
+ virtualenv <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env> --python=python2.7
New python executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python2.7>
Also creating executable in <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins6863260875181215316.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.1.1)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.1.1)
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins5714892822879311748.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker>
Cloning into '<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins8534264892162086019.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/pip> install -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt>
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Collecting rsa==3.1.4
Downloading rsa-3.1.4.tar.gz (36 kB)
Collecting absl-py
Downloading absl-py-0.9.0.tar.gz (104 kB)
Collecting jinja2>=2.7
Using cached Jinja2-2.11.2-py2.py3-none-any.whl (125 kB)
Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/requirements.txt> (line 17)) (44.1.1)
Collecting colorlog[windows]==2.6.0
Downloading colorlog-2.6.0-py2.py3-none-any.whl (11 kB)
Collecting blinker>=1.3
Downloading blinker-1.4.tar.gz (111 kB)
Collecting futures>=3.0.3
Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Collecting PyYAML==5.1.2
Downloading PyYAML-5.1.2.tar.gz (265 kB)
Collecting pint>=0.7
Downloading Pint-0.9-py2.py3-none-any.whl (138 kB)
Collecting numpy==1.16.4
Downloading numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting contextlib2>=0.5.1
Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Collecting pywinrm
Downloading pywinrm-0.4.1.tar.gz (36 kB)
Collecting timeout-decorator
Downloading timeout-decorator-0.4.1.tar.gz (4.8 kB)
Collecting google-cloud-datastore
Downloading google_cloud_datastore-1.13.0-py2.py3-none-any.whl (105 kB)
Collecting google-cloud-monitoring
Downloading google_cloud_monitoring-1.0.0-py2.py3-none-any.whl (235 kB)
Collecting pyasn1>=0.1.3
Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting six
Using cached six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting enum34
Using cached enum34-1.1.10-py2-none-any.whl (11 kB)
Collecting MarkupSafe>=0.23
Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Collecting colorama; extra == "windows"
Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting funcsigs; python_version == "2.7"
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting xmltodict
Downloading xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB)
Collecting requests>=2.9.1
Using cached requests-2.24.0-py2.py3-none-any.whl (61 kB)
Collecting requests_ntlm>=0.3.0
Downloading requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
Using cached google_api_core-1.21.0-py2.py3-none-any.whl (90 kB)
Collecting google-cloud-core<2.0dev,>=1.0.3
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2020.6.20-py2.py3-none-any.whl (156 kB)
Collecting idna<3,>=2.5
Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<4,>=3.0.2
Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
Using cached urllib3-1.25.9-py2.py3-none-any.whl (126 kB)
Collecting cryptography>=1.3
Downloading cryptography-2.9.2-cp27-cp27mu-manylinux2010_x86_64.whl (2.7 MB)
Collecting ntlm-auth>=1.0.2
Downloading ntlm_auth-1.5.0-py2.py3-none-any.whl (29 kB)
Collecting google-auth<2.0dev,>=1.18.0
Using cached google_auth-1.18.0-py2.py3-none-any.whl (90 kB)
Collecting protobuf>=3.12.0
Using cached protobuf-3.12.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting pytz
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting grpcio<2.0dev,>=1.29.0; extra == "grpc"
Using cached grpcio-1.30.0-cp27-cp27mu-manylinux2010_x86_64.whl (3.0 MB)
Collecting cffi!=1.11.3,>=1.8
Downloading cffi-1.14.0-cp27-cp27mu-manylinux1_x86_64.whl (387 kB)
Collecting ipaddress; python_version < "3"
Downloading ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting pycparser
Downloading pycparser-2.20-py2.py3-none-any.whl (112 kB)
Building wheels for collected packages: rsa, absl-py, blinker, PyYAML, pywinrm, timeout-decorator
Building wheel for rsa (setup.py): started
Building wheel for rsa (setup.py): finished with status 'done'
Created wheel for rsa: filename=rsa-3.1.4-py2-none-any.whl size=43339 sha256=bdf6b0e581b0faa3959caf5a0fcaf04e58fab7bb52a132f9dd2b7eba2ef92646
Stored in directory: /home/jenkins/.cache/pip/wheels/b9/0a/0a/a99d0c1fe13d01efdf7aa29be87a4b1ac608072c150c669ba6
Building wheel for absl-py (setup.py): started
Building wheel for absl-py (setup.py): finished with status 'done'
Created wheel for absl-py: filename=absl_py-0.9.0-py2-none-any.whl size=121931 sha256=9c9cf68e8e007fecc644c64e37ebc0e3a18b59dc109564e1a774924929a2dd64
Stored in directory: /home/jenkins/.cache/pip/wheels/37/83/b0/40d9e9f3d5a7021dfda2f3ea1f0088235679cd7747761c7b93
Building wheel for blinker (setup.py): started
Building wheel for blinker (setup.py): finished with status 'done'
Created wheel for blinker: filename=blinker-1.4-py2-none-any.whl size=13451 sha256=d4913ab6291bea152b19bee89ea787344e271ea667df19820ca065d85fae4e14
Stored in directory: /home/jenkins/.cache/pip/wheels/7b/1f/a0/7ce496c69b9be7cef75645749e256d5ef2dc9d08336f92248b
Building wheel for PyYAML (setup.py): started
Building wheel for PyYAML (setup.py): finished with status 'done'
Created wheel for PyYAML: filename=PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl size=44911 sha256=2a24998388b0057fef73f0509fbf69deb15b64db3e0491ad290e5422bc4050f1
Stored in directory: /home/jenkins/.cache/pip/wheels/87/9b/a7/9bfdaa1487acce958269a6b5f86db2e4d38204dff4e256e23a
Building wheel for pywinrm (setup.py): started
Building wheel for pywinrm (setup.py): finished with status 'done'
Created wheel for pywinrm: filename=pywinrm-0.4.1-py2.py3-none-any.whl size=40451 sha256=74788c785cb3de8f086723f2683ef22191430c570d8187564e59c2a7164a7328
Stored in directory: /home/jenkins/.cache/pip/wheels/2d/f7/d6/a43d1d088536280fca881232b9c352fa8c6be425d53e09d595
Building wheel for timeout-decorator (setup.py): started
Building wheel for timeout-decorator (setup.py): finished with status 'done'
Created wheel for timeout-decorator: filename=timeout_decorator-0.4.1-py2-none-any.whl size=5015 sha256=b1721ba99fe4b20aff61f2afd53d0be0f37425b0b0638af2dcaf91bf7a2672c3
Stored in directory: /home/jenkins/.cache/pip/wheels/dc/f9/36/5ff60c0209ec9f77bce9aa535b7e570a87da8731ba6416db9d
Successfully built rsa absl-py blinker PyYAML pywinrm timeout-decorator
Installing collected packages: pyasn1, rsa, six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, xmltodict, certifi, idna, chardet, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, pywinrm, timeout-decorator, pyasn1-modules, cachetools, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-core, google-cloud-datastore, google-cloud-monitoring
Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2020.6.20 cffi-1.14.0 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.9.2 enum34-1.1.10 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.21.0 google-auth-1.18.0 google-cloud-core-1.3.0 google-cloud-datastore-1.13.0 google-cloud-monitoring-1.0.0 googleapis-common-protos-1.52.0 grpcio-1.30.0 idna-2.10 ipaddress-1.0.23 jinja2-2.11.2 ntlm-auth-1.5.0 numpy-1.16.4 pint-0.9 protobuf-3.12.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 pytz-2020.1 pywinrm-0.4.1 requests-2.24.0 requests-ntlm-1.1.0 rsa-3.1.4 six-1.15.0 timeout-decorator-0.4.1 urllib3-1.25.9 xmltodict-0.12.0
[beam_PerformanceTests_WordCountIT_Py36] $ /bin/bash -xe /tmp/jenkins1384838948887778304.sh
+ <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/env/.perfkit_env/bin/python> <https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py36_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/> --beam_location=<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py36 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE'
Traceback (most recent call last):
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/pkb.py",> line 19, in <module>
from perfkitbenchmarker.pkb import Main
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 76, in <module>
from perfkitbenchmarker import archive
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py",> line 24, in <module>
from perfkitbenchmarker.providers.aws.util import AWS_PATH
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py",> line 19, in <module>
from perfkitbenchmarker import events
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py",> line 26, in <module>
from perfkitbenchmarker import data
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py",> line 34, in <module>
from perfkitbenchmarker import temp_dir
File "<https://ci-beam.apache.org/job/beam_PerformanceTests_WordCountIT_Py36/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 29, in <module>
import functools32 as functools
ImportError: No module named functools32
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org