You are viewing a plain text version of this content. The canonical link for it is here.

Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/01/31 19:18:04 UTC

Build failed in Jenkins: beam_PerformanceTests_WordCountIT_Py35 #1037

See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/1037/display/redirect?page=changes>

Changes:

[robertwb] Only cache first page of paginated state.

[robertwb] Perform bundle-level caching if no cache token is given.

[robertwb] [BEAM-8298] Support side input cache tokens.

[robertwb] fix continuation token iter

[robertwb] lint for side input tokens

[robertwb] Fix state cache test.

[robertwb] TODO about two-level caching.

[robertwb] CachingStateHandler unit test.

[robertwb] test lint

[robertwb] Fix extending non-list.

[robertwb] Fix flink counters test.

[mxm] [BEAM-9132] Avoid logging misleading error messages during pipeline

[github] [BEAM-8889] Cleanup Beam to GCS connector interfacing code so it uses


------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on apache-beam-jenkins-1 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/>
No credentials specified
Wiping out workspace first.
Cloning the remote Git repository
Cloning repository https://github.com/apache/beam.git
 > git init <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src> # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/*
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git fetch --tags --progress https://github.com/apache/beam.git +refs/heads/*:refs/remotes/origin/* +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 06831353fea86ce605770beba9e147b345fb13ea (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 06831353fea86ce605770beba9e147b345fb13ea
Commit message: "[BEAM-8889] Cleanup Beam to GCS connector interfacing code so it uses higher level objects such as GoogleCloudStorage. (#10617)"
 > git rev-list --no-walk 37dd015fc38f71c85dff5a9892d3d0a72e74cbb4 # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
[beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins491225509533137667.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker>
[beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins367348696091979746.sh
+ rm -rf <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env>
[beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins5487252531637014289.sh
+ virtualenv <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env> --python=python2.7
New python executable in <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/python2.7>
Also creating executable in <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/python>
Installing setuptools, pip, wheel...
done.
Running virtualenv with interpreter /usr/bin/python2.7
[beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins3209526663236009920.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/pip> install --upgrade setuptools pip
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Requirement already up-to-date: setuptools in ./env/.perfkit_env/lib/python2.7/site-packages (44.0.0)
Requirement already up-to-date: pip in ./env/.perfkit_env/lib/python2.7/site-packages (20.0.2)
[beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins5406851903989442746.sh
+ git clone https://github.com/GoogleCloudPlatform/PerfKitBenchmarker.git <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker>
Cloning into '<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker'...>
[beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins1796799330827331040.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/pip> install -r <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/requirements.txt>
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Processing /home/jenkins/.cache/pip/wheels/8e/28/49/fad4e7f0b9a1227708cbbee4487ac8558a7334849cb81c813d/absl_py-0.9.0-cp27-none-any.whl
Collecting jinja2>=2.7
  Using cached Jinja2-2.11.1-py2.py3-none-any.whl (126 kB)
Requirement already satisfied: setuptools>=40.3.0 in ./env/.perfkit_env/lib/python2.7/site-packages (from -r <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/requirements.txt> (line 16)) (44.0.0)
Collecting colorlog[windows]==2.6.0
  Using cached colorlog-2.6.0-py2.py3-none-any.whl (11 kB)
Processing /home/jenkins/.cache/pip/wheels/92/a0/00/8690a57883956a301d91cf4ec999cc0b258b01e3f548f86e89/blinker-1.4-cp27-none-any.whl
Collecting futures>=3.0.3
  Using cached futures-3.3.0-py2-none-any.whl (16 kB)
Processing /home/jenkins/.cache/pip/wheels/d9/45/dd/65f0b38450c47cf7e5312883deb97d065e030c5cca0a365030/PyYAML-5.1.2-cp27-cp27mu-linux_x86_64.whl
Collecting pint>=0.7
  Using cached Pint-0.9-py2.py3-none-any.whl (138 kB)
Collecting numpy==1.16.4
  Using cached numpy-1.16.4-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting contextlib2>=0.5.1
  Using cached contextlib2-0.6.0.post1-py2.py3-none-any.whl (9.8 kB)
Processing /home/jenkins/.cache/pip/wheels/8f/db/f3/3028984b926c1c0165d7be4ead1092d219bee6ef71e9219578/pywinrm-0.4.1-py2.py3-none-any.whl
Processing /home/jenkins/.cache/pip/wheels/f1/e6/ea/7387e3629cb46ba65140141f972745b823f4486c6fe884ccb8/timeout_decorator-0.4.1-cp27-none-any.whl
Collecting google-cloud-monitoring
  Using cached google_cloud_monitoring-0.34.0-py2.py3-none-any.whl (220 kB)
Collecting six
  Using cached six-1.14.0-py2.py3-none-any.whl (10 kB)
Collecting enum34; python_version < "3.4"
  Using cached enum34-1.1.6-py2-none-any.whl (12 kB)
Collecting MarkupSafe>=0.23
  Using cached MarkupSafe-1.1.1-cp27-cp27mu-manylinux1_x86_64.whl (24 kB)
Collecting colorama; extra == "windows"
  Using cached colorama-0.4.3-py2.py3-none-any.whl (15 kB)
Collecting funcsigs; python_version == "2.7"
  Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Collecting requests-ntlm>=0.3.0
  Using cached requests_ntlm-1.1.0-py2.py3-none-any.whl (5.7 kB)
Collecting requests>=2.9.1
  Using cached requests-2.22.0-py2.py3-none-any.whl (57 kB)
Collecting xmltodict
  Using cached xmltodict-0.12.0-py2.py3-none-any.whl (9.2 kB)
Collecting google-api-core[grpc]<2.0.0dev,>=1.14.0
  Using cached google_api_core-1.16.0-py2.py3-none-any.whl (70 kB)
Collecting cryptography>=1.3
  Using cached cryptography-2.8-cp27-cp27mu-manylinux2010_x86_64.whl (2.3 MB)
Collecting ntlm-auth>=1.0.2
  Using cached ntlm_auth-1.4.0-py2.py3-none-any.whl (29 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2019.11.28-py2.py3-none-any.whl (156 kB)
Collecting chardet<3.1.0,>=3.0.2
  Using cached chardet-3.0.4-py2.py3-none-any.whl (133 kB)
Collecting idna<2.9,>=2.5
  Using cached idna-2.8-py2.py3-none-any.whl (58 kB)
Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1
  Using cached urllib3-1.25.8-py2.py3-none-any.whl (125 kB)
Collecting google-auth<2.0dev,>=0.4.0
  Using cached google_auth-1.11.0-py2.py3-none-any.whl (76 kB)
Collecting protobuf>=3.4.0
  Using cached protobuf-3.11.2-cp27-cp27mu-manylinux1_x86_64.whl (1.3 MB)
Processing /home/jenkins/.cache/pip/wheels/2c/f9/7f/6eb87e636072bf467e25348bbeb96849333e6a080dca78f706/googleapis_common_protos-1.51.0-cp27-none-any.whl
Collecting pytz
  Using cached pytz-2019.3-py2.py3-none-any.whl (509 kB)
Collecting grpcio<2.0dev,>=1.8.2; extra == "grpc"
  Using cached grpcio-1.26.0-cp27-cp27mu-manylinux2010_x86_64.whl (2.4 MB)
Collecting cffi!=1.11.3,>=1.8
  Using cached cffi-1.13.2-cp27-cp27mu-manylinux1_x86_64.whl (384 kB)
Collecting ipaddress; python_version < "3"
  Using cached ipaddress-1.0.23-py2.py3-none-any.whl (18 kB)
Collecting pyasn1-modules>=0.2.1
  Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
  Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting rsa<4.1,>=3.1.4
  Using cached rsa-4.0-py2.py3-none-any.whl (38 kB)
Processing /home/jenkins/.cache/pip/wheels/f2/9a/90/de94f8556265ddc9d9c8b271b0f63e57b26fb1d67a45564511/pycparser-2.19-py2.py3-none-any.whl
Collecting pyasn1<0.5.0,>=0.4.6
  Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Installing collected packages: six, enum34, absl-py, MarkupSafe, jinja2, colorama, colorlog, blinker, futures, PyYAML, funcsigs, pint, numpy, contextlib2, certifi, chardet, idna, urllib3, requests, pycparser, cffi, ipaddress, cryptography, ntlm-auth, requests-ntlm, xmltodict, pywinrm, timeout-decorator, pyasn1, pyasn1-modules, cachetools, rsa, google-auth, protobuf, googleapis-common-protos, pytz, grpcio, google-api-core, google-cloud-monitoring
Successfully installed MarkupSafe-1.1.1 PyYAML-5.1.2 absl-py-0.9.0 blinker-1.4 cachetools-3.1.1 certifi-2019.11.28 cffi-1.13.2 chardet-3.0.4 colorama-0.4.3 colorlog-2.6.0 contextlib2-0.6.0.post1 cryptography-2.8 enum34-1.1.6 funcsigs-1.0.2 futures-3.3.0 google-api-core-1.16.0 google-auth-1.11.0 google-cloud-monitoring-0.34.0 googleapis-common-protos-1.51.0 grpcio-1.26.0 idna-2.8 ipaddress-1.0.23 jinja2-2.11.1 ntlm-auth-1.4.0 numpy-1.16.4 pint-0.9 protobuf-3.11.2 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.19 pytz-2019.3 pywinrm-0.4.1 requests-2.22.0 requests-ntlm-1.1.0 rsa-4.0 six-1.14.0 timeout-decorator-0.4.1 urllib3-1.25.8 xmltodict-0.12.0
[beam_PerformanceTests_WordCountIT_Py35] $ /bin/bash -xe /tmp/jenkins908139483214340657.sh
+ <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/env/.perfkit_env/bin/python> <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/pkb.py> --project=apache-beam-testing --dpb_log_level=INFO --bigquery_table=beam_performance.wordcount_py35_pkb_results --k8s_get_retry_count=36 --k8s_get_wait_interval=10 --temp_dir=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/> --beam_location=<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src> --official=true --dpb_service_zone=fake_zone --beam_sdk=python --benchmarks=beam_integration_benchmark --beam_it_class=apache_beam.examples.wordcount_it_test:WordCountIT.test_wordcount_it --beam_it_module=:sdks:python:test-suites:dataflow:py35 --beam_prebuilt=true --beam_python_sdk_location=build/apache-beam.tar.gz --beam_runner=TestDataflowRunner --beam_it_timeout=1200 '--beam_it_args=--project=apache-beam-testing,--staging_location=gs://temp-storage-for-end-to-end-tests/staging-it,--temp_location=gs://temp-storage-for-end-to-end-tests/temp-it,--input=gs://apache-beam-samples/input_small_files/ascii_sort_1MB_input.0000*,--output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output,--expect_checksum=ea0ca2e5ee4ea5f218790f28d0b9fe7d09d8d710,--num_workers=10,--autoscaling_algorithm=NONE'
Traceback (most recent call last):
  File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/pkb.py",> line 19, in <module>
    from perfkitbenchmarker.pkb import Main
  File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py",> line 75, in <module>
    from perfkitbenchmarker import archive
  File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/archive.py",> line 24, in <module>
    from perfkitbenchmarker.providers.aws.util import AWS_PATH
  File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/__init__.py",> line 19, in <module>
    from perfkitbenchmarker import events
  File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/events.py",> line 26, in <module>
    from perfkitbenchmarker import data
  File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/data/__init__.py",> line 34, in <module>
    from perfkitbenchmarker import temp_dir
  File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/temp_dir.py",> line 29, in <module>
    import functools32 as functools
ImportError: No module named functools32
Build step 'Execute shell' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org